In order to track target effectively,a high precision target tracking algorithm and high performance hardware system are designed.The target feature extraction method and high speed hardware system structure are discussed in detail.In order to meet the requirements of high precision tacking,a proved local texture feature extraction method is presented which combining the proved feature extraction algorithm and different value match methods based on analyzing its advantage and disadvantage thoroughly.In order to meet the requirements of real time processing,a target tracking hardware system based on high performance DSP and FPGA is designed.Experiment results indicate that the precision of this method is better than the traditional methods and the target displacement can be computed in less than 20 ms.The proposed method and hardware system have already be used in actual project which can meet the requirements of the real time processing,high precision and anti-rotation.