Future Generation Computer Systems · 2023 · 37 citations · 22 references
ComputingIndustrial EngineeringArtificial IntelligenceMachine LearningSchedulingReal-time Resource ManagementReinforcement LearningScheduling OptimizationDag SchedulingDeep Reinforcement LearningWorkflow Scheduling
High-Performance Computing (HPC) is essential to support the advance in multiple research and industrial fields. Despite the recent growth in processing and networking power, the HPC Data Centers (DCs) are finite, and should be carefully managed to host multiple jobs. The scheduling of tasks (composing a job) is a crucial and complex task, once the reflexes of the scheduler’s decisions are perceptible both for users (e.g., slowdown) and for infrastructure administrators (e.g., use of resources and queue length). In fact, the process of scheduling workflows atop a DC can be modeled as a graph mapping problem. While an undirected graph is used to represent the DC, a Directed Acyclic Graph (DAG) is used to express the tasks dependencies . Each vertex and edge from both graphs can have weights associated with them, denoting the residual capacities for DC resources, as well as computing and networking demands for workflows. Motivated by the combinatorial explosion of the aforementioned scheduling problem, the integration of Machine Learning (ML) for generating or improving scheduling policies is a reality, however the proposals in the specialized literature opt, mostly, for using simplified models to reduce the search space or are trained to specific scenarios, which leads to policies that eventually fall short of real DCs expectations. Given this challenge, this work applies Actor–Critic (AC) Reinforcement Learning (RL) to schedule DAG-based workflows. Instead of proposing a new policy, the AC RL is used to select the appropriated scheduling policy from a pool of consolidated algorithms, guided by the DAGs workload and DC usage. The AC RL-based scheduler analyzes the DAGs queue and the DC status to define which algorithms are better suited to improve the overall performance indicators in each scenario instance. The simulation protocol comprises multiple analysis with distinct workload configurations, number of jobs, queue ordering polices and strategies to select the target DC servers. The results demonstrated that the AC RL selects the scheduling policy which fits the current workload and DC status.
22
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
The rise of “big data” on cloud computing: Review and open research issues
Ibrar Yaqoob, Nor Badrul Anuar, Salimah Mokhtar et al. · Information Systems · 2014 · 2.6K citations
The Complexity of Flowshop and Jobshop Scheduling
M. R. Garey, David Johnson, Ravi Sethi · Mathematics of Operations Research · 1976 · 2.6K citations
A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
I. Grondman, Lucian Buşoniu, Gabriel A. D. Lopes et al. · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · 2012 · 1K citations · Full text
Computing, Computer Science, Finance +13
Raouf Boutaba, Mohammad A. Salahuddin, Noura Limam et al. · Journal of Internet Services and Applications · 2018 · 993 citations · Full text