A survey of LiDAR and camera fusion enhancement

Abstract

Recently, two types of common sensors, LiDAR and Camera, show significant performance on all tasks in 3D vision. LiDAR provides accurate 3D geometry structure, while camera captures more scene context and semantic information. The fusion of two different sensor becomes a fundamental and common idea to achieve better performance. To give a thorough cognition of the complementary and boosting about two kind of sensors. This paper briefly reviews the fusion and enhancement systems between both two sensors in the field of depth completion, 3D object detection, 2D\3D semantic segmentation and 3D object tracking. Meanwhile, the state of art fusion algorithms is quantitatively demonstrated, in this paper, based on the in KITTI widely-used public dataset. Furthermore, the technical challenge and the future potential of LiDAR and camera fusion are also discussed.