IEEE Internet of Things Journal · 2021 · 239 citations · 50 references
ComputingAutonomous SystemsComputer SystemsEdge ComputingInternet Of ThingsMobile ComputingLatency OptimizationMobile Edge ComputingTask OffloadingDynamic OffloadingEdge Computing OffloadingEnergy ConsumptionMobile Edge Computing ArchitecturePartial OffloadingQos-aware SchedulingReal-time RequirementsResource-constrained Devices
The development of Industrial Internet of Things (IIoT) and Industry 4.0 has completely changed the traditional manufacturing industry. Intelligent IIoT technology usually involves a large number of intensive computing tasks. Resource-constrained IIoT devices often cannot meet the real-time requirements of these tasks. As a promising paradigm, the mobile-edge computing (MEC) system migrates the computation intensive tasks from resource-constrained IIoT devices to nearby MEC servers, thereby obtaining lower delay and energy consumption. However, considering the varying channel conditions as well as the distinct delay requirements for various computing tasks, it is challenging to coordinate the computing task offloading among multiple users. In this article, we propose an autonomous partial offloading system for delay-sensitive computation tasks in multiuser IIoT MEC systems. Our goal is to provide offloading services with minimum delay for better Quality of Service (QoS). Enlighten by the recent advancement of reinforcement learning (RL), we propose two RL-based offloading strategies to automatically optimize the delay performance. Specifically, we first implement the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$Q$ </tex-math></inline-formula> -learning algorithm to provide a discrete partial offloading decision. Then, to further optimize the system performance with more flexible task offloading, the offloading decisions are given as continuous based on deep deterministic policy gradient (DDPG). The simulation results show that the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$Q$ </tex-math></inline-formula> -learning scheme reduces the delay by 23%, and the DDPG scheme reduces the delay by 30%.
50
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Continuous control with deep reinforcement learning
Timothy Lillicrap, Jonathan J. Hunt, Alexander Pritzel et al. · arXiv (Cornell University) · 2016 · 6.8K citations · Full text
Computing, Computer Science, Physics +17
Fog computing and its role in the internet of things
Flavio Bonomi, Rodolfo Milito, Jiang Zhu et al. · 2012 · 6K citations · Full text
The Case for VM-Based Cloudlets in Mobile Computing
Mahadev Satyanarayanan, Paramvir Bahl, Rafaela Cáceres et al. · IEEE Pervasive Computing · 2009 · 3.7K citations