Gesture based communication is the fundamental method for correspondence for those with hearing and vocal incapacities. Communication via gestures comprises of making shapes or developments with human hands as for the head or other body parts. In this paper, we propose a new framework for recognizing sign gestures by using Hidden Markov Model (HMM) and Histogram based methods. Initially, the noise of an image will be eliminated by Wiener Filter and the image will be segmented with the help of Histogram oriented methods - Adaptive Histogram technique and then features will be extracted. The extracted features will be given to the HMM for training and recognition of gestures. Our experimental results show a better performance in terms of recognizing gestures from a blurred image compared to the existing segmentation methods.