According to the detailed analysis of characteristics of ground,cloud and the target image of the infrared detector system,the detection algorithms based on background brightness and gradient signal-to-noise ratio and the variance of target vertical edge beating are introduced,which can reduce the false alarm rate in ground and cloud,as well as the algorithm processes and results are given.This algorithm as one of the assistant algorithms is used in the infrared detector system,and achieves good results.