Nowadays, socializing of humans with pet animals has increased. The pet animals are treated as a part of the family and the physical interaction hasalso improved owing to the fact that the infected animals are not easily identifiable at an early stage and children are more prone to get infected. Thisleads to the necessity for monitoring and analyzing the behavior of the pet animals. The current trend is moving toward smart homes as the camerasare getting cheaper and easily available. The vision-based approach is one of the solutions to identify the behavioral changes of the pet animals. In thispaper, the study on behavioral analysis of dogs and cats as pet animals is reviewed.