2009 · 213 citations · 29 references
ComputingCloud ComputingComputer ScienceCloud ArchitectureMachine LearningVirtualizationCloud Resource ManagementCloud VirtualizationCompute Resource ManagementResource ProvisioningResource SchedulingVirtual Machine MonitorsAdaptabilityCloud Resource ProvisioningCloud SchedulingConfiguration Management ProcessDynamic Resource ProvisioningModel-based AlgorithmsVirtual Machine Resource AllocationVirtual Machine Scheduling
Virtual machine (VM) technology enables multiple VMs to share resources on the same host. Resources allocated to the VMs should be re-configured dynamically in response to the change of application demands or resource supply. Because VM execution involves privileged domain and VM monitor, this causes uncertainties in VMs' resource to performance mapping and poses challenges in online determination of appropriate VM configurations. In this paper, we propose a reinforcement learning (RL) based approach, namely VCONF, to automate the VM configuration process. VCONF employs model-based RL algorithms to address the scalability and adaptability issues in applying RL in systems management. Experimental results on both controlled environments and a testbed of clouds with Xen VMs and representative server workloads demonstrate the effectiveness of VCONF. The approach is able to find optimal (near optimal) configurations in small scale systems and shows good adaptability and scalability.
29
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Advances in neural information processing systems 7
Krzysztof J. Cios, Mark E. Shields · Neurocomputing · 1997 · 22.3K citations
Xen and the art of virtualization
Paul Barham, Boris Dragovic, Keir Fraser et al. · ACM SIGOPS Operating Systems Review · 2003 · 5.9K citations
Live migration of virtual machines
Christopher J. Clark, Keir Fraser, Steven Hand et al. · 2005 · 2.6K citations
Xen and the art of virtualization
Paul Barham, Boris Dragovic, Keir Fraser et al. · 2003 · 2.1K citations