Reinforcement Learning through Interaction among Multiple Agents

Abstract

In ordinary reinforcement learning algorithms, a single agent learns to achieve a goal through many episodes. If a learning problem is complicated, it may take a much computation time to obtain the optimal policy. Meanwhile, for optimization problems, multi-agent search methods such as particle swarm optimization have been recognized that they are able to find rapidly a global optimal solution for multi-modal functions with wide solution space. This paper proposes a reinforcement learning algorithm by using multiple agents. In this algorithm, the multiple agents learn through not only their respective experiences but also interaction among them. For the interaction methods this paper proposes three strategies: the best action-value strategy, the average action-value strategy and the particle swarm strategy