IEEE Network · 2019 · 1K citations · 17 references
ComputingComputer ScienceComputer SystemsArtificial IntelligenceEdge ComputingMobile ComputingEdge ArchitectureEdge Artificial IntelligenceEdge DevicesEdge-cloud ArchitectureEdge-cloud IntegrationMobile Edge ComputingDeep Reinforcement LearningEdge CachingEdge Federated LearningEdge IntelligenceEdge NodesEdge-ai IntegrationMobile Edge Computing ArchitectureSystem Optimization
Edge computing bridges cloud capacity and device demands, accelerating content delivery and improving mobile service quality amid rapid mobile communication advances. The study proposes integrating deep reinforcement learning and federated learning into mobile edge systems to optimize computing, caching, and communication. They design the “In‑Edge AI” framework that enables devices and edge nodes to exchange learning parameters via federated learning, using deep reinforcement learning for dynamic system‑level optimization and application‑level enhancement while reducing communication overhead. Evaluation shows that In‑Edge AI achieves near‑optimal performance with low learning overhead and remains cognitive and adaptive to mobile communication systems.
Recently, along with the rapid development of mobile communication technology, edge computing theory and techniques have been attracting more and more attentions from global researchers and engineers, which can significantly bridge the capacity of cloud and requirement of devices by the network edges, and thus can accelerate the content deliveries and improve the quality of mobile services. In order to bring more intelligence to the edge systems, compared to traditional optimization methodology, and driven by the current deep learning techniques, we propose to integrate the Deep Reinforcement Learning techniques and Federated Learning framework with the mobile edge systems, for optimizing the mobile edge computing, caching and communication. And thus, we design the "In-Edge AI" framework in order to intelligently utilize the collaboration among devices and edge nodes to exchange the learning parameters for a better training and inference of the models, and thus to carry out dynamic system-level optimization and application-level enhancement while reducing the unnecessary system communication load. "In-Edge AI" is evaluated and proved to have near-optimal performance but relatively low overhead of learning, while the system is cognitive and adaptive to the mobile communication systems. Finally, we discuss several related challenges and opportunities for unveiling a promising upcoming future of "In-Edge AI".
17
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Reinforcement Learning: An Introduction
Jeffrey D. Johnson, Jinghong Li, Zengshi Chen · Neurocomputing · 2000 · 8.7K citations
Deep Reinforcement Learning with Double Q-Learning
Hado van Hasselt, Arthur Guez, David Silver · 2016 · 6K citations · Full text
A Survey on Mobile Edge Computing: The Communication Perspective
Yuyi Mao, Changsheng You, Jun Zhang et al. · IEEE Communications Surveys & Tutorials · 2017 · 5.4K citations