2019 · 24 citations · 30 references
ComputingComputer ScienceEdge ComputingMachine LearningMobile ComputingEdge ArchitectureEdge InfrastructureEdge Service PlacementEdge-cloud ArchitectureMobile Edge ComputingCost ModelsEdge Computing OptimizationEdge Service MigrationMigration ManagementModel-free Reinforcement LearningService MigrationService PlacementService Placement Optimization
Mobile edge computing is gaining traction due to its ability to deliver ultra-low-latency services for mobile applications. This is achieved through a federation of edge clouds in close proximity of users. However, the intrinsic mobility of users brings a high level of dynamics to the edge environment, calling for sophisticated service migration management across the edge clouds. Previous solutions for edge service placement/migration are architecture-specific, centralized, or are based on restricted cost models. These limitations leave doubts about the practicality of these approaches due to the lack of a standardized reference model for edge clouds. In this paper, we propose a general framework for optimizing edge service migration based on reinforcement learning techniques. Using our framework, edge service migration strategies can be learned with respect to a large variety of optimization goals. Moreover, our learning-based algorithm is agnostic to the underlying architecture and resource constraints. Preliminary results show that our model-free learning-based approach can compete with model-based baselines and adapt to different objectives.
30
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Reinforcement Learning: An Introduction
Jeffrey D. Johnson, Jinghong Li, Zengshi Chen · Neurocomputing · 2000 · 8.7K citations
The Case for VM-Based Cloudlets in Mobile Computing
Mahadev Satyanarayanan, Paramvir Bahl, Rafaela Cáceres et al. · IEEE Pervasive Computing · 2009 · 3.7K citations