IEEE Transactions on Mobile Computing · 2024 · 11 citations · 47 references
ComputingComputer SystemsEdge ComputingQueuing TheorySchedulingPriority QueuesQueueing TheoryResource SchedulingResource-constrained SchedulingTask SchedulingVirtual Network FunctionsCooperative SchedulingDeep Reinforcement LearningExperience ReplayQueueing-based SchedulingQueuing Delay AnalysisScheduling Under Resource ConstraintsShortest Remaining Processing TimeVirtualized Network Functions
Effective Service Function Chains (SFCs) mapping and Virtual Network Functions (VNFs) scheduling are crucial to ensure high-quality service provision for Internet of Things (IoT) tasks. Meeting the varying demands of multiple SFCs poses a significant challenge, particularly when working with the limited resources available in edge computing networks. Most existing working focuses on uniformly mapping and scheduling service requests in a batch processing manner within a given time period, without taking the diversity and priority of VNFs into account. When there is a sudden surge in demand, the issues of VNF queueing waiting and resources imbalance become prominent. To address the mentioned issues, this paper proposes a Deep Reinforcement Learning (DRL)-based VNF cooperative scheduling framework with priority-weighted delay. In light of the urgency of VNFs with higher priorities and the limitations of available resources, we begin by modeling an average queuing delay with priority weight based on the shortest remaining time priority technique. We then formulate a mathematical optimization problem to minimize the modeled delay in VNF scheduling process while providing suitable multidimensional resources in the edge network. Finally, a DRL method with experience replay and target Q-network is designed to effectively obtain the optimal solutions of the optimization problem from experience. The experimental results show that our proposed method outperforms its peers in terms of SFC request acceptance, delay, load balance, and resource utilization.
47
Deep Reinforcement Learning with Double Q-Learning
Hado van Hasselt, Arthur Guez, David Silver · 2016 · 6K citations · Full text
Deep Reinforcement Learning: A Brief Survey
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage et al. · IEEE Signal Processing Magazine · 2017 · 4.3K citations
An Introduction to Deep Reinforcement Learning
Vincent François-Lavet, Peter Henderson, Riashat Islam et al. · Foundations and Trends® in Machine Learning · 2018 · 1.3K citations · Full text
Computing, Computer Science, Finance +15
Sushant Jain, Alok Kumar, Subhasree Mandal et al. · ACM SIGCOMM Computer Communication Review · 2013 · 963 citations
Vijay Pereira, Εlias Hadjielias, Michael Christofi et al. · Human Resource Management Review · 2021 · 472 citations · Full text
Management, Human Resource Management, Organizational Behavior +17