IEEE Transactions on Wireless Communications · 2024 · 12 citations · 31 references
ComputingComputer SystemsInformation TechnologyComputer NetworksMarkov Decision ProcessesOptimizationEnergy-efficient Mobile ComputingMobile Edge ComputingMobile NetworksNetwork OptimizationPerformance OptimizationTask OffloadingEdge Task OffloadingEnergy ConsumptionEnergy Efficiency In Mobile NetworksEnergy Optimization AlgorithmsEnergy-aware Task OffloadingEnergy-efficient Resource AllocationLyapunov FunctionsSystem Performance Modeling
In this paper, we investigate the energy minimization problem in cell-free mobile edge computing (MEC) networks under dynamic channel conditions and random arrival tasks. We aim to minimize the total energy consumption of user equipment (UEs) and MEC servers (MECSs) by jointly optimizing MECS active/sleep mode selection, UE-MECS association decision (MSAD), and task offloading, communication, and computation resource allocation (TORA) across two different timescales. Considering that the involved optimization variables affect the system performance in different timescales, we decouple the formulated stochastic optimization problem into two subproblems: MSAD operating in the large timescale and TORA in the small timescale. Leveraging the Lyapunov method, the stochastic TORA problem is decoupled into a series of deterministic problems, of which the closed-form solutions are presented. Furthermore, the MSAD problem is reformulated as a constrained Markov decision process (MDP). Then, we propose a double dueling deep Q-network (D3QN) to learn the optimal MSAD based on the TORA results. Numerical results demonstrate that the proposed online TORA-assisted MSAD learning algorithm has effective convergence and achieves substantial energy reductions for the MEC networks compared with the benchmark schemes.
31
Deep Reinforcement Learning with Double Q-Learning
Hado van Hasselt, Arthur Guez, David Silver · 2016 · 6K citations · Full text
A Survey on Mobile Edge Computing: The Communication Perspective
Yuyi Mao, Changsheng You, Jun Zhang et al. · IEEE Communications Surveys & Tutorials · 2017 · 5.4K citations
Tarik Taleb, Konstantinos Samdanis, Badr Eddine Mada et al. · IEEE Communications Surveys & Tutorials · 2017 · 1.7K citations · Full text