IEEE Transactions on Artificial Intelligence · 2024 · 27 citations · 40 references
ComputingAutonomous SystemsComputer ScienceAerial RoboticsArtificial IntelligenceMachine LearningNavigation LearningNavigation PlanningPolicy LearningReinforcement LearningSafe Robot LearningConvergenceDeep Reinforcement LearningDeep Reinforcement Learning For NavigationEvasion TechniquesNavigationNavigation Policy LearningPursuit-evasion GamesSafe Navigation
Safe navigation of drones in the presence of adversarial physical attacks from multiple pursuers is a challenging task. This paper proposes a novel approach, asynchronous multistage deep reinforcement learning (AMS-DRL), to train adversarial neural networks that can learn from the actions of multiple evolved pursuers and adapt quickly to their behavior, enabling the drone to avoid attacks and reach its target. Specifically, AMS-DRL evolves adversarial agents in a pursuit-evasion game where the pursuers and the evader are asynchronously trained in a bipartite graph way during multiple stages. Our approach guarantees convergence by ensuring Nash equilibrium among agents from the game-theory analysis. We evaluate our method in extensive simulations and show that it outperforms baselines with higher navigation success rates. We also analyze how parameters such as the relative maximum speed affect navigation performance. Furthermore, we have conducted physical experiments and validated the effectiveness of the trained policies in real-time flights. A success rate heatmap is introduced to elucidate how spatial geometry influences navigation outcomes. Project website: <ext-link ext-link-type="uri" xlink:href="https://github.com/NTU-ICG/AMS-DRL-for-Pursuit-Evasion" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/NTU-ICG/AMS-DRL-for-Pursuit-Evasion</ext-link> .
40
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
A note on two problems in connexion with graphs
E. Dijkstra · Numerische Mathematik · 1959 · 23.8K citations
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
David Silver, Thomas Hubert, Julian Schrittwieser et al. · Science · 2018 · 3.5K citations · Full text
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Oriol Vinyals, I. Babuschkin, Wojciech Marian Czarnecki et al. · Nature · 2019 · 3.4K citations