IEEE Transactions on Green Communications and Networking · 2022 · 85 citations · 35 references
ComputingComputer ScienceComputer SystemsInternet Of ThingsMarkov Decision ProcessesMobile ComputingEnergy-efficient Mobile ComputingMobile Edge ComputingReinforcement LearningResource ProvisioningTask OffloadingCollaborative OffloadingEnergy ConsumptionEnergy-efficient Resource ManagementJoint OffloadingMulti-user OffloadingOptimization-based OffloadingReinforcement Learning For OffloadingResource-constrained Computing
Recently, Low Earth Orbit (LEO) satellite-based Internet of Things (LEO-IoT) becomes attractive for computation offloading in mobile-edge computing (MEC) since it can overcome terrain obstacles, such as in depopulated villages and disaster sites. However, it is extremely hard to allocate bandwidth and power resources jointly with multiple users and satellites. In this paper, we study offloading in collaborative LEO-IoT where satellites forward data from users to the MEC server, with the goal of making offloading fast and energy efficient. To achieve this goal, we first define the data offloading in collaborative LEO-IoT as an optimization problem with resource constraints. Then we formulate the optimization problem as a Partially Observable Markov Decision Processes (POMDP), which differs from the existing Markov Decision Processes (MDP) work for the offloading scenario. We further propose a novel Multi-Agent Information Broadcasting and Judging (MAIBJ) algorithm to allocate resources in a collaborative manner. Finally, extensive experiments are conducted with various configurations and the results show that MAIBJ can shorten at least 33% of transmission latency and save at least 42% of energy consumption compared with several baseline algorithms.
35
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Continuous control with deep reinforcement learning
Timothy Lillicrap, Jonathan J. Hunt, Alexander Pritzel et al. · arXiv (Cornell University) · 2016 · 6.8K citations · Full text
Computing, Computer Science, Physics +17