IEEE Sensors Journal · 2021 · 36 citations · 23 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningMarkov Decision ProcessesConstrained Markov Decision ProcessesOptimal ControlPolicy LearningReinforcement LearningResource OptimizationTask AllocationConstrained Reinforcement LearningDeep Reinforcement LearningLagrangian RelaxationPolicy-based Resource AllocationPower AllocationRadar TrackingTarget TrackingTracking Performance Optimization
In this article, a data-driven multiple radar system (MRS) resource allocation method for target tracking is developed based on deep reinforcement learning. The goal is to achieve the given tracking accuracy requirement with minimum long-short term power consumption by radar selection and MRS power allocation. In theory, thanks to the existence of the given tracking accuracy requirement, this problem can be modeled as a constrained Markov decision process (MDP). For this problem, a constrained deep reinforcement learning (DRL) is introduced based on deep deterministic policy gradient. Specifically, by relaxing the original constrained MDP problem to unconstrained MDP problem with Lagrangian relaxation procedure, the tracking accuracy requirement is introduced into the derivation of policy gradient of actor network in deep deterministic policy gradient, which makes the tracking performance with the resource allocation policy learned by DRL able to meet the given tracking requirements. Meanwhile, considering the limited radar and power resource of MRS, three output layers of the actor network is redesigned for determining the actions of radar selection and power allocation. In this way, the assignment and transmit power of each radar of MRS can be given in real time at each tracking interval. Simulation results have shown the effectiveness of the proposed method.
23
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations