IEEE Transactions on Intelligent Vehicles · 2024 · 28 citations · 18 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceAutonomous VehiclesInformation RetrievalAutonomous NavigationIntelligent Transportation SystemsTraffic SafetyVehicle PerceptionAutonomous Vehicle NavigationAutonomous Vehicle SafetyDriving Decision-making SupportFoundationIntelligent Transportation Systems Decision SupportRetrievalRetrieval-augmented GenerationTrustworthy Ai
Autonomous driving based on foundation models has recently garnered widespread attention. However, the risk of hallucinations inherent in foundation models could compromise the safety and reliability of autonomous driving systems. This letter, as part of a series of reports from the Distributed/Decentralized Hybrid Workshop on Foundation/Infrastructure Intelligence (DHW-FII), aims to tackle these issues. We introduce VistaRAG, which integrates retrieval-augmented generation (RAG) technologies into autonomous driving systems based on foundation models, to address the inherent reliability challenges in decision-making. VistaRAG employs a dynamic retrieval mechanism to access highly relevant driving experience, real-time road network status, and other contextual information from external databases. This aids foundation models in informed reasoning and decision-making, thereby enhancing the safety and trustworthiness of foundation-model-based autonomous driving systems under complex traffic scenarios.
18
Retrieval-Augmented Generation for Large Language Models: A Survey
Yunfan Gao, Yun Xiong, Xinyu Gao et al. · arXiv (Cornell University) · 2023 · 658 citations · Full text
IVS 05: new developments and research trends for intelligent vehicles
Li Li, Jingyan Song, Fei–Yue Wang et al. · IEEE Intelligent Systems · 2005 · 98 citations