IEEE Transactions on Communications · 2018 · 296 citations · 34 references
ComputingComputer ScienceComputer SystemsComputer NetworksDigital CommunicationDistributed SystemsMobile NetworkingMobile NetworksVirtual RealityMulti-attribute Utility TheoryNash Equilibrium ProblemsNetwork Performance OptimizationNoncooperative GamesQos ManagementQuality Of Service ProvisioningSmall Cell NetworksTransmission Delay
In this paper, the problem of resource management is studied for a network of wireless virtual reality (VR) users communicating over small cell networks (SCNs). In order to capture the VR users' quality-of-service (QoS) in SCNs, a novel VR model, based on multi-attribute utility theory, is proposed. This model jointly accounts for VR metrics, such as tracking accuracy, processing delay, and transmission delay. In this model, the small base stations (SBSs) act as the VR control centers that collect the tracking information from VR users over the cellular uplink. Once this information is collected, the SBSs will then send the 3-D images and accompanying audio to the VR users over the downlink. Therefore, the resource allocation problem in VR wireless networks must jointly consider both the uplink and downlink. This problem is then formulated as a noncooperative game and a distributed algorithm based on the machine learning framework of echo state networks (ESNs) is proposed to find the solution of this game. The proposed ESN algorithm enables the SBSs to predict the VR QoS of each SBS and is guaranteed to converge to mixed-strategy Nash equilibrium. The analytical result shows that each user's VR QoS jointly depends on both VR tracking accuracy and wireless resource allocation. Simulation results show that the proposed algorithm yields significant gains, in terms of VR QoS utility, that reach up to 22.2% and 37.5%, respectively, compared with Q-learning and a baseline proportional fair algorithm. The results also show that the proposed algorithm has a faster convergence time than Q-learning and can guarantee low delays for VR services.
34
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Jeffrey G. Andrews, Stefano Buzzi, Wan Choi et al. · IEEE Journal on Selected Areas in Communications · 2014 · 8.2K citations · Full text
Introduction to Linear Regression Analysis.
Renato Assunção, Paul D. Sampson, Douglas C. Montgomery et al. · Journal of the American Statistical Association · 1993 · 5.4K citations
An Introduction to the Theory of Statistics