Object Tracking Based on the Fusion of Roadside LiDAR and Camera Data

Abstract

Tracking road users with high resolution is important for connected vehicles. Due to the complicated environments, tracking objects with a single sensor could not meet the requirements of high-resolution trajectories due to occlusions. How to acquire accurate and complete trajectories based on multi-source data is a major challenge for researchers and engineers. This paper developed a novel tracking method based on the fusion of roadside LiDAR and camera. According to the relationship between the number of points and distance, the adaptive weight coefficient related to 3D trajectory information was determined. The performance of the proposed method was evaluated at five selected sites. The proposed tracking method had high performance in terms of speed calculation, tracking range, the rate of object loss, and the repairing rate of disconnected trajectories. The proposed method can benefit many transportation areas, such as traffic volume counting, vehicle speed tracking, and traffic safety analysis.