IEEE Robotics and Automation Letters · 2022 · 46 citations · 38 references
EngineeringComputer ScienceRobotics EngineeringArtificial IntelligenceMulti-robot SystemsRoboticsAutonomous ExplorationExploration-exploitation TradeoffMulti-robot ExplorationMulti-robot LearningPolicy LearningReinforcement LearningDecentralized ExplorationDeep Reinforcement LearningExplorationExploration With Communication ConstraintsMulti-agent ExplorationMulti-agent Reinforcement LearningScalabilityScalable Multi-agent Learning
Cooperative multi-robot teams need to be able to explore cluttered and unstructured environments while dealing with communication dropouts that prevent them from exchanging local information to maintain team coordination. Therefore, robots need to consider high-level teammate intentions during action selection. In this letter, we present the first Macro Action Decentralized Exploration Network (MADE-Net) using multi-agent deep reinforcement learning (DRL) to address the challenges of communication dropouts during multi-robot exploration in unseen, unstructured, and cluttered environments. Simulated robot team exploration experiments were conducted and compared against classical and DRL methods where MADE-Net outperformed all benchmark methods in terms of computation time, total travel distance, number of local interactions between robots, and exploration rate across various degrees of communication dropouts. A scalability study in 3D environments showed a decrease in exploration time with MADE-Net with increasing team and environment sizes. The experiments presented highlight the effectiveness and robustness of our method.
38
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Deep Reinforcement Learning: A Brief Survey
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage et al. · IEEE Signal Processing Magazine · 2017 · 4.3K citations
Coordinated multi-robot exploration
Wolfram Burgard, Mark Moors, Cyrill Stachniss et al. · IEEE Transactions on Robotics · 2005 · 1.1K citations