On the searching and tracking of ground targets,the images captured from the air-based IRST are composed of targets and complicated moving surface background,because of the self-movement of the airplane.A background suppression algorithm based on inter-frame motion estimation is proposed to overcome the influences of moving surface background to the target tracking,according to the study of movement characters of background and targets in the image list captured from the air-based IRST stabilization platform structure.