2022 IEEE Intelligent Vehicles Symposium (IV) · 2022 · 12 citations · 18 references
ComputingAutonomous SystemsComputer ScienceAutonomous VehiclesComputer VisionVisual AttentionAttention NetworksDeep LearningPolicy LearningReinforcement LearningScene UnderstandingVehicle PerceptionAttentionContextConvolutional Neural NetworksDeep Reinforcement LearningReinforcement Learning For VisionVision TransformersVisuomotor Policy Learning
Driving in a complex and dynamic urban environment is a difficult task that requires a complex decision policy. In order to make informed decisions, one needs to gain an understanding of the long-range context and the importance of other vehicles. In this work, we propose to use Vision Transformer (ViT) to learn a driving policy in urban settings with birds-eye-view (BEV) input images. The ViT network learns the global context of the scene more effectively than with earlier proposed Convolutional Neural Networks (ConvNets). Furthermore, ViT’s attention mechanism helps to learn an attention map for the scene which allows the ego car to determine which surrounding cars are important to its next decision. We demonstrate that a DQN agent with a ViT backbone outperforms baseline algorithms with ConvNet backbones pre-trained in various ways. In particular, the proposed method helps reinforcement learning algorithms to learn faster, with increased performance and less data than baselines.
18
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov et al. · arXiv (Cornell University) · 2020 · 21.6K citations · Full text
VectorNet: Encoding HD Maps and Agent Dynamics From Vectorized Representation
Jiyang Gao, Chen Sun, Hang Zhao et al. · 2020 · 898 citations