IEEE Internet of Things Journal · 2019 · 57 citations · 31 references
ComputingDecision SciencesEnergy ManagementInternet Of ThingsMarkov Decision ProcessesEnergy Management SystemsEnergy UseIot Energy ManagementPolicy LearningPower ControlReinforcement LearningBattery ModelingDeep Reinforcement LearningEnergy HarvestingEnergy Harvesting SystemsLong Short-term Memory NetworksNetwork LifetimeQ-learningReinforcement Learning For Scheduling
The Internet of Things (IoT) application has a crucial need for long-term and self-sustainable operations. Energy harvesting (EH) technique has attracted great attention in IoT as it may significantly increase the network lifetime by using renewable energy sources. In this paper, we study a simple IoT system composed of one base station (BS) and multiple EH user equipments (UEs), where the system control is modeled as a Markov decision process without any prior knowledge assumed on the energy dynamics. The central controller, i.e., the BS, is in charge of scheduling a subset of UEs to access the limited orthogonal channels and regulating transmission power for the scheduled UEs. Applying reinforcement learning (RL) methods in this situation is technically challenging since the state and action spaces are continuous. With a long short-term memory (LSTM)-based algorithm to predict the UEs' battery states, we propose an actor-critic deep Q-network (DQN) RL algorithm to simultaneously deal with the access and continuous power control problem, by considering both the sum rate and prediction loss. The experimental results show that the proposed RL algorithm can achieve better performances when compared with the existing benchmarks.
31
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Continuous control with deep reinforcement learning
Timothy Lillicrap, Jonathan J. Hunt, Alexander Pritzel et al. · arXiv (Cornell University) · 2016 · 6.8K citations · Full text
Computing, Computer Science, Physics +17
Playing Atari with Deep Reinforcement Learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · arXiv (Cornell University) · 2013 · 5.1K citations · Full text