IEEE Transactions on Network and Service Management · 2021 · 23 citations · 30 references
ComputingCloud ComputingCloud Performance OptimizationDistributed SystemsMarkov Decision ProcessesCloud Resource ManagementCompute Resource ManagementReinforcement LearningResource AllocationResource ProvisioningResource SchedulingAllocationCloud Computing SystemsConvergenceDynamic Resource AllocationDynamic Resource ManagementReconfigurationResource Allocation AlgorithmsState Replication
Dynamic resource allocation to satisfy varying, concurrent and unpredictable demands from multiple applications is a key need in cloud systems. A fundamental challenge is the need to find the right balance between over-allocation, which satisfies each application’s varying needs without requiring frequent allocation changes, and system efficiency which requires that the allocation exactly matches the application needs. However, allocating resources close to current needs will result in frequent allocation changes. This can be detrimental to applications since there may be fixed costs (state replication, policy reconfiguration, etc.) that need to be incurred by applications for each allocation change. In this paper, we develop an MDP-based dynamic allocation scheme that uses reinforcement learning to satisfy unpredictable application demands. It minimizes the overall resource allocation needed to satisfy varying application demands while meeting application constraints on the rate of allocation changes. We prove convergence bounds and use real-world traces to study the performance.
30
Reinforcement Learning: An Introduction
Jeffrey D. Johnson, Jinghong Li, Zengshi Chen · Neurocomputing · 2000 · 8.7K citations
Energy-aware server provisioning and load dispatching for connection-intensive internet services
PRESS: PRedictive Elastic ReSource Scaling for cloud systems
Zhenhuan Gong, Xiaohui Gu, John Wilkes · 2010 · 541 citations