The implementation of object handoff in overlapping fields of view is one of the key techniques of continual object tracking in multi-camera tracking systems.Feature matching methods and the algorithm based on field of view are adopted in conventional solutions towards this problem.However,FM is not practical in application because it is not computationally efficient and the results heavily depend on the parameter settings of the cameras.The approaches based on FOV suffer from the delay of the detection of newly appeared objects,causing the results of consistent labeling are not reliable.Recently,projective invariants method is used to handoff object,but it will make mistakes in the case of multiple objects appear closely.The paper proposes a novel scheme for object handoff based on projective invariants and histogram matching.The experimental results show that our method could solve the problem above.