ComputingAutonomous SystemsComputer ScienceAerial RoboticsMachine LearningPath PlanningAutonomous NavigationDeep LearningNavigation PlanningPolicy LearningReinforcement LearningRobot NavigationDeep Reinforcement LearningDeep Reinforcement Learning For NavigationLearning-based NavigationLong Short-term Memory NetworksNavigation In Dynamic EnvironmentsReinforcement Learning For NavigationUav NavigationUnmanned Aerial Vehicle Navigation
Unmanned Aerial Vehicle (UAV) navigation is aimed at guiding a UAV to the desired destinations along a collision-free and efficient path without human interventions, and it plays a crucial role in autonomous missions in harsh environments. The recently emerging Deep Reinforcement Learning (DRL) methods have shown promise for addressing the UAV navigation problem, but most of these methods cannot converge due to the massive amounts of interactive data when a UAV is navigating in high dynamic environments, where there are numerous obstacles moving fast. In this work, we propose an improved DRL-based method to tackle these fundamental limitations. To be specific, we develop a distributed DRL framework to decompose the UAV navigation task into two simpler sub-tasks, each of which is solved through the designed Long Short-Term Memory (LSTM) based DRL network by using only part of the interactive data. Furthermore, a clipped DRL loss function is proposed to closely stack the two sub-solutions into one integral for the UAV navigation problem. Extensive simulation results are provided to corroborate the superiority of the proposed method in terms of the convergence and effectiveness compared with those of the state-of-the-art DRL methods.
33
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Deep Reinforcement Learning with Double Q-Learning
Hado van Hasselt, Arthur Guez, David Silver · 2016 · 6K citations · Full text
Christopher J. Watkins, Peter Dayan · Machine Learning · 1992 · 3.7K citations
Tom Schaul, John Quan, Ioannis Antonoglou et al. · arXiv (Cornell University) · 2015 · 2K citations · Full text