2018 · 47 citations · 14 references
ComputingElectrical EngineeringMachine LearningMarkov Decision ProcessesWireless CommunicationsHandover ManagementMobile CommunicationMobile NetworksReinforcement LearningReinforcement Learning FoundationsWireless NetworksBlockageHandover DecisionHandover OptimizationOptimal Decision MakingPedestrian Movement PatternsPerformance DegradationReinforcement Learning TheoryThroughput
This paper discusses the optimal decision-making for predictive handover in millimeter-wave (mmWave) communication networks using information of pedestrian movement. In mmWave communication networks, human blockage causes significant performance degradation. Hence, to maximize the throughput, it might be important to perform a handover predictively using information such as location and velocity of a pedestrian. To optimize the timing to perform the predictive handover, this paper presents a reinforcement learning framework. The important point in this framework is learning the optimal handover policy maximizing the future throughput expected under the locations and velocities of a pedestrian. To learn the optimal policy, this paper applies Q-learning. The numerical results demonstrate that the learned handover decisions outperform the heuristic handover decisions in terms of throughput performance.
14
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
A survey of millimeter wave communications (mmWave) for 5G: opportunities and challenges
Yong Niu, Yong Li, Depeng Jin et al. · Wireless Networks · 2015 · 1.3K citations
On the Levy-Walk Nature of Human Mobility
Injong Rhee, Seongik Hong, Kyunghan Lee et al. · IEEE/ACM Transactions on Networking · 2011 · 1K citations