2025 · 14 citations · 51 references
ComputingAutonomous SystemsComputer ScienceAutonomous VehiclesComputer VisionSensor FusionDecision-level FusionDeep LearningFeature-level FusionLate FusionMultisensor Data IntegrationVehicle PerceptionAdaptabilityDeep Learning-based FusionFusion StrategiesLarge Language ModelsMulti-modal PerceptionMulti-modal Sensor FusionMulti-sensor FusionMultimodal Sensor Fusion
Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion strategies into data-level, feature-level, and decision-level cate-gories and then provides a systematic review of deep learning-based methods corresponding to each strategy. We present key multi-modal datasets and discuss their applicability in ad-dressing real-world challenges, particularly in adverse weather conditions and complex urban environments. Additionally, we explore emerging trends, including the integration of Vision-Language Models (VLMs), Large Language Models (LLMs), and the role of sensor fusion in end-to-end autonomous driving, highlighting its potential to enhance system adaptability and robustness. Our work offers valuable insights into current meth-ods and future directions for multi-sensor fusion in autonomous driving.
51
Vision meets robotics: The KITTI dataset
Andreas Geiger, Philip Lenz, Christoph Stiller et al. · The International Journal of Robotics Research · 2013 · 9.7K citations
Multi-view 3D Object Detection Network for Autonomous Driving
Xiaozhi Chen, Huimin Ma, Ji Wan et al. · 2017 · 3.4K citations
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
Pei Sun, Henrik Kretzschmar, Xerxes Dotiwalla et al. · 2020 · 3K citations
Joint 3D Proposal Generation and Object Detection from View Aggregation
Jason S. Ku, Melissa Mozifian, Jungwook Lee et al. · 2018 · 1.7K citations
Argoverse: 3D Tracking and Forecasting With Rich Maps
Ming-Fang Chang, John Lambert, Patsorn Sangkloy et al. · 2019 · 1.4K citations