Video surveillance cameras are placed in many places such as bank, hospital, toll gates, airports, etc. To take advantage of the video in real time, a human must monitor the system continuously in order to alert security officers if there is an emergency. Besides, for event detection a person can observe four cameras with good accuracy at a time. Therefore, this requires expensive human resources for real time video surveillance using current technology. The trajectory of one or more targets obtains for object tracking while recording above space and time. By tracking various objects, the burden of detection by human sentinels is greatly alleviated. Efficient and reliable automatic alarm system is useful for many ATM surveillance applications. ATM Video monitoring systems present many challenging research issues in human abnormal behaviors detection approaches. The framework of ATM video surveillance system encompassing various factors, such as image acquisition, background estimation, background subtraction, segmentation, people counting and tracking are briefly discussed in this chapter.