IEEE Transactions on Mobile Computing · 2024 · 30 citations · 38 references
ComputingAutonomous SystemsComputer ScienceInternet Of ThingsMarkov Decision ProcessesOptimizationConstrained Markov Decision ProcessesIot Energy ManagementMission PlanningPolicy LearningReinforcement LearningSensor NetworksConstrained Multi-agent Reinforcement LearningConstrained Reinforcement LearningEnergy Optimization AlgorithmsEnergy TransferJoint OptimizationMarkov Decision ModelsTrajectory PlanningUnmanned Aerial Vehicle Sensing
The development of Internet of Things (IoT) technology has led to the emergence of a large number of Intelligent Sensing Devices (ISDs). Since their limited physical sizes constrain the battery capacity, wireless powered IoT networks assisted by Unmanned Aerial Vehicles (UAVs) for energy transfer and data acquisition have attracted great interest. In this paper, we formulate an optimization problem to maximize system energy efficiency while satisfying the constraints of UAV mobility and safety, ISD quality of service and task completion time. The formulated problem is constructed as a Constrained Markov Decision Process (CMDP) model, and a Multi-agent Constrained Deep Reinforcement Learning (MCDRL) algorithm is proposed to learn the optimal UAV movement policy. In addition, an ISD-UAV connection assignment algorithm is designed to manage the connection in the UAV sensing range. Finally, performance evaluations and analysis based on real-world data demonstrate the superiority of our solution.
38
Wei Xu, Zhaohui Yang, Derrick Wing Kwan Ng et al. · IEEE Journal of Selected Topics in Signal Processing · 2023 · 589 citations