In the data fusion system composed of radar and infrared sensor installed in high speed of dynamic platform, the system error estimation and target correlation are dependent and are difficult very much. To solve the problem, a new target correlation algorithm based on pattern classification is proposed in the article according to the property of system errors variation. The approach realizes pattern classification by BP neural network. It needn’t estimate the system error and compensate it, and has a tolerance to system error. The experiment shows that the average correct probability for target-correlation in the data fusion between the above two kind of sensors is more than 86%.