2021 · 102 citations · 32 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceMachine LearningRoboticsDecentralized PlanningMulti-agent Robot LearningMulti-agent SystemsPolicy LearningReinforcement LearningDecentralized ExecutionDecentralized LearningDecentralized Policy LearningDeep Reinforcement LearningMulti-agent LearningMulti-agent Path PlanningMulti-agent Reinforcement LearningShortest Paths
Multi-Agent Path Finding (MAPF) is essential to large-scale robotic systems. Recent methods have applied reinforcement learning (RL) to learn decentralized polices in partially observable environments. A fundamental challenge of obtaining collision-free policy is that agents need to learn co-operation to handle congested situations. This paper combines communication with deep Q-learning to provide a novel learning based method for MAPF, where agents achieve cooperation via graph convolution. To guide RL algorithm on long-horizon goal-oriented tasks, we embed the potential choices of shortest paths from single source as heuristic guidance instead of using a specific path as in most existing works. Our method treats each agent independently and trains the model from a single agent’s perspective. The final trained policy is applied to each agent for decentralized execution. The whole system is distributed during training and is trained under a curriculum learning strategy. Empirical evaluation in obstacle-rich environment indicates the high success rate with low average step of our method.
32
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Jun‐Young Chung, Çağlar Gülçehre, Kyunghyun Cho et al. · arXiv (Cornell University) · 2014 · 10.8K citations · Full text
Yoshua Bengio, Jérôme Louradour, Ronan Collobert et al. · 2009 · 5K citations · Full text
Dueling Network Architectures for Deep Reinforcement Learning
Ziyu Wang, Tom Schaul, Matteo Hessel et al. · arXiv (Cornell University) · 2015 · 1.8K citations · Full text