This paper addresses an approach for identification of the emotion and conforming the emotions by fusing to the facial gestures. Various Techniques have been floated in the area of emotion recognition based speech signals. However these speech signals that are generated may not being in coherent with the actual inner feelings. Therefore in this paper a model is proposed by fusing the facial expression and the uttered speech voices. In ordered to tested developed model, synthesized data set is considered and performances evaluated using the metrics like precision and recalled. © Springer India 2016.