IEEE Transactions on Wireless Communications · 2022 · 59 citations · 25 references
ComputingComputer SystemsMachine LearningMobile ComputingMobile SystemsDeep LearningEnergy-efficient Mobile ComputingMobile NetworkingMobile NetworksPower ManagementReinforcement LearningAction Space FormulationDeep Reinforcement LearningEnergy ConsumptionEnergy Efficiency In Mobile NetworksEnergy-efficient CommunicationEnergy-efficient NetworkingMode ConversionSleep Modes
With the explosive growth in mobile data traffic, ultra-dense network (UDN) where a large number of small cells are densely deployed on top of macro cells has received a great deal of attention in recent years. While UDN offers a number of benefits, an upsurge of energy consumption in UDN due to the intensive deployment of small cells has now become a major bottleneck in achieving the primary goals viz., 100-fold increase in the throughput in 5G+ and 6G. In recent years, an approach to reduce the energy consumption of base stations (BSs) by selectively turning off the lightly-loaded BSs, referred to as the sleep mode technique, has been suggested. However, determining an appropriate active/sleep modes of BSs is a difficult task due to the huge computational overhead and inefficiency caused by the frequent BS mode conversion. An aim of this paper is to propose a deep reinforcement learning (DRL)-based approach to achieve a reduction of energy consumption in UDN. Key ingredient of the proposed scheme is to use decision selection network to reduce the size of action space. Numerical results show that the proposed scheme can significantly reduce the energy consumption of UDN while ensuring the rate requirement of network.
25
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Mastering the game of Go without human knowledge
David Silver, Julian Schrittwieser, Karen Simonyan et al. · Nature · 2017 · 9.2K citations
Engineering, Educational Psychology, Cognitive Psychology +7
Resource Management with Deep Reinforcement Learning
Hongzi Mao, Mohammad Alizadeh, Ishai Menache et al. · 2016 · 1.2K citations