2023 · 18 citations · 15 references
ComputingInformation TechnologyMarkov Decision ProcessesMobile ComputingMobile SystemsLoad BalancingMobile NetworkingMobile NetworksReinforcement LearningTraffic EngineeringTraffic Flow ManagementDeep Reinforcement LearningHierarchical Reinforcement LearningLoad Balancing ModelsSystem Performance ModelingTraffic DistributionTraffic Flow OptimizationTraffic Load BalancingTraffic Steering
In 5G non-standalone mode, an intelligent traffic steering mechanism can vastly aid in ensuring a smooth user experience by selecting the best radio access technology (RAT) from a multi-RAT environment for a specific traffic flow. In this paper, we propose a novel load-aware traffic steering algorithm based on hierarchical reinforcement learning (HRL) while satisfying the diverse quality of service requirements of different traffic types. HRL can significantly increase system performance using a bi-level architecture having a meta-controller and a controller. In our proposed method, the meta-controller provides an appropriate threshold for load balancing, while the controller performs traffic admission to an appropriate RAT in the lower level. Simulation results show that HRL outperforms a Deep Q-Learning (DQN) and a threshold-based heuristic baseline with 8.49%, 12.52% higher average system throughput and 27.74%, 39.13% lower network delay, respectively.
15
A Survey on 5G Usage Scenarios and Traffic Models
Jorge Navarro‐Ortiz, Pablo Romero-Díaz, Sandra Sendra et al. · IEEE Communications Surveys & Tutorials · 2020 · 699 citations · Full text