A new tracking scheme that is based on feature fusion is proposed.In this paper,by combining the gray space and gradient space,our target model is represented in the form of a weighting histogram using its gray feature and gradient feature,and frame-to-frame tracking is performed using mean shift.Experiments turned out the algorithm works efficiently and robustly for the occluding object tracking and the tracking when the gray scale of target and background are similar.