In‐Vehicle AR‐HUD System to Provide Driving‐Safety Information

Abstract

Augmented reality (AR) is currently being applied actively to commercial products, and various types of intelligent AR systems combining both the Global Positioning System and computer‐vision technologies are being developed and commercialized. This paper suggests an in‐vehicle head‐up display (HUD) system that is combined with AR technology. The proposed system recognizes driving‐safety information and offers it to the driver. Unlike existing HUD systems, the system displays information registered to the driver's view and is developed for the robust recognition of obstacles under bad weather conditions. The system is composed of four modules: a ground obstacle detection module, an object decision module, an object recognition module, and a display module. The recognition ratio of the driving‐safety information obtained by the proposed AR‐HUD system is about 73%, and the system has a recognition speed of about 15 fps for both vehicles and pedestrians.