Face detection system and other subsidiary research associated with face like emotion detection, facial landmark detection has gained tremendous focus and momentum in the last few years. Face is not only one of the most cogent, naturally pre-eminent means used by human beings for the recognition of a person, but also for communicating emotions and intentions and in regulating interactions with the environment and other persons in the vicinity. It has been estimated that facial non-verbal behavior of the speaker, manifested by expressions, contributes more than half to the effect of the spoken message which is more than the verbal part and the vocal part. Hence, facial expressions have a key role in verbal and non-verbal communication. Furthermore, according to Psychological studies important cues for certain behaviors, such as deception and stress, are micro-expressions, since they often represent leakage to behavior control. Analysis of facial images promotes a way for knowing the human behavior Human behavior refers to the range of behaviors exhibited by humans and which are influenced by culture, attitudes, emotions, values, ethics, authority, rapport, hypnosis, persuasion, coercion and genetics. This article discusses the recent development and techniques involved in analyzing the human behavior by means of facial expression analysis.