Aiming at the disadvantages of frame difference method and background difference method for detecting moving objects with low accuracy and weak adaptive ability,a moving object detection and recognition algorithm based on improved five-frame difference method combined with background difference method and template matching was proposed.The moving object is detected from the video sequence by combining the improved five frame difference and background difference algorithm.Using morphological method to remove noise and improve the effect of moving target extraction.On the basis of Harris algorithm extraction of image matching eigenvalues,corner registration is used to improve the accuracy of image recognition.The target detection recognition and tracking is realized by the method of matching the feature of the target and the adaptive template image.The experiment shows that the method is simple and effective,and has a good detection and recognition effect for moving targets with noise and partially shielded,the recognition rate reaches 95%.