2020 · 70 citations · 24 references
ComputingAutonomous SystemsComputer ScienceMachine LearningSensor FusionUnmanned Aircraft SystemsDeep LearningEnergy-efficient Mobile ComputingMobile SensingReinforcement LearningSensor NetworksState Of Charge ManagementAblation ModelingCrowdsensingDeep Reinforcement LearningHyperparameter OptimizationHyperparameter TuningMobile CrowdsensingSpatiotemporal Data Models
Different from using human-centric mobile devices like smartphones, unmanned aerial vehicles (UAVs) can be utilized to form a new UAV crowdsensing paradigm, where UAVs are equipped with build-in high-precision sensors, to provide data collection services especially for emergency situations like earthquakes or flooding. In this paper, we aim to propose a new deep learning based framework to tackle the problem that a group of UAVs energy-efficiently and cooperatively collect data from low-level sensors, while charging the battery from multiple randomly deployed charging stations. Specifically, we propose a new deep model called "j-PPO+ConvNTM" which contains a novel spatiotemporal module "Convolution Neural Turing Machine" (ConvNTM) to better model long-sequence spatiotemporal data, and a deep reinforcement learning (DRL) model called "j-PPO", where it has the capability to make continuous (i.e., route planing) and discrete (i.e., either to collect data or go for charging) action decisions simultaneously for all UAVs. Finally, we perform extensive simulation to show its illustrative movement trajectories, hyperparameter tuning, ablation study, and compare with four other baselines.
24
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Continuous control with deep reinforcement learning
Timothy Lillicrap, Jonathan J. Hunt, Alexander Pritzel et al. · arXiv (Cornell University) · 2016 · 6.8K citations · Full text
Computing, Computer Science, Physics +17
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Xingjian Shi, Zhourong Chen, Hao Wang et al. · arXiv (Cornell University) · 2015 · 6.6K citations · Full text
Trust Region Policy Optimization
John Schulman, Sergey Levine, Philipp Moritz et al. · arXiv (Cornell University) · 2015 · 3.1K citations · Full text