Towards the p roblem of real time detecting and tracking in infrared image, a practical system is built based on midwave stareing focal plane infrared sensor, HEPC9 ( for double2DSP management) , double－DSP C6201 and double－FPGA. The proposed algorithm of detection and tracking is successfully optimized and transp lanted to the hardware processor. Processing results with the real image sequences show the system can real－time and effectively detect and track the smallmoving target in low SNR infrared image sequenceswith 50 frame persecond, 3203 240 perframe,14 bit perp ixel.