In Autonomous driving technology detecting pedestrians and vehicles should be fast and efficient in order to avoid accidents. Pedestrian detection and tracking is challenging for complex real world scenes. In proposed system Kalman filter has been used to detect and track the pedestrians. From three frames initially eigen object is computed in video sequences for detection of moving objects, then shape information is used to classify humans and other objects. Moreover with the help of continues multiple frames occlusion between objects get calculated. In the proposed system an application is developed which gives automatic warning in case of doubtful activities performed by pedestrian of zone monitoring which can be used in various domains like defence and traffic monitoring. Proposed algorithm gives accurate moving object detection and advanced sensors are used to detect human movements ahead and alert the driver by using buzzer, result does not affect by body pose of individual. © BEIESP.