On Developing a UAV Pursuit-Evasion Policy Using Reinforcement Learning

Abstract

We present an approach for learning a reactive maneuver policy for a UAV involved in a close-quarters one-on-one aerial engagement. Specifically, UAVs with behaviors learned through reinforcement learning can match or improve upon simple, but effective behaviors for intercept. In this paper, a framework for developing reactive policies that can learn to exploit behaviors is discussed. In particular, the A3C algorithm with a deep neural network is applied to the aerial combat domain. The efficacy of the learned policy is demonstrated in Monte Carlo experiments. An architecture that can transfer the learned policy from simulation to an actual aircraft and its effectiveness in live-flight are also demonstrated.