IEEE Robotics and Automation Letters · 2025 · 34 citations · 29 references
EngineeringAerospace EngineeringRobotics EngineeringAerial RoboticsArtificial IntelligenceRoboticsObstacle AvoidancePolicy LearningSafe Robot LearningSim-to-real TransferTrajectory OptimizationTrajectory PredictionDeep Reinforcement LearningDeep Reinforcement Learning For NavigationNavigationNavigation In Dynamic EnvironmentsNavigation Policy LearningProximal Policy OptimizationReinforcement Learning For NavigationTrajectory Prediction For Obstacle Avoidance
Safe flight in dynamic environments requires unmanned aerial vehicles (UAVs) to make effective decisions when navigating cluttered spaces with moving obstacles. Traditional approaches often decompose decision-making into hierarchical modules for prediction and planning. Although these handcrafted systems can perform well in specific settings, they might fail if environmental conditions change and often require careful parameter tuning. Additionally, their solutions could be suboptimal due to the use of inaccurate mathematical model assumptions and simplifications aimed at achieving computational efficiency. To overcome these limitations, this letter introduces the NavRL framework, a deep reinforcement learning-based navigation method built on the Proximal Policy Optimization (PPO) algorithm. NavRL utilizes our carefully designed state and action representations, allowing the learned policy to make safe decisions in the presence of both static and dynamic obstacles, with zero-shot transfer from simulation to real-world flight. Furthermore, the proposed method adopts a simple but effective safety shield for the trained policy, inspired by the concept of velocity obstacles, to mitigate potential failures associated with the black-box nature of neural networks. To accelerate the convergence, we implement the training pipeline using NVIDIA Isaac Sim, enabling parallel training with thousands of quadcopters. Simulation and physical experiments show that our method ensures safe navigation in dynamic environments and results in the fewest collisions compared to benchmarks.
29
FAST-LIO2: Fast Direct LiDAR-Inertial Odometry
Wei Xu, Yixi Cai, Dongjiao He et al. · IEEE Transactions on Robotics · 2022 · 1.5K citations
Socially aware motion planning with deep reinforcement learning
Yu Fan Chen, Michael Everett, Miao Liu et al. · 2017 · 718 citations
Champion-level drone racing using deep reinforcement learning
Elia Kaufmann, Leonard Bauersfeld, Antonio Loquercio et al. · Nature · 2023 · 575 citations · Full text
DroNet: Learning to Fly by Driving
Antonio Loquercio, Ana I. Maqueda, Carlos R. del‐Blanco et al. · IEEE Robotics and Automation Letters · 2018 · 503 citations