Adaptive control of virtualized resources in utility computing environments

TLDR

Data centers are often under‑utilized because of over‑provisioning and fluctuating application demands, and virtualization can consolidate workloads but introduces QoS challenges, especially for multi‑tier applications that require tier‑specific resources. This work presents an adaptive resource control system that dynamically reallocates resource shares among application tiers to satisfy QoS targets while maximizing overall utilization. The system employs classical control theory with a black‑box model to handle complex enterprise workloads, and is evaluated on a Xen‑based virtual data center testbed. Experiments with two multi‑tier applications (RUBiS and TPC‑W) show that the controller maintains high utilization and meets QoS goals despite varying resource demands.

Abstract

Data centers are often under-utilized due to over-provisioning as well as time-varying resource demands of typical enterprise applications. One approach to increase resource utilization is to consolidate applications in a shared infrastructure using virtualization. Meeting application-level quality of service (QoS) goals becomes a challenge in a consolidated environment as application resource needs differ. Furthermore, for multi-tier applications, the amount of resources needed to achieve their QoS goals might be different at each tier and may also depend on availability of resources in other tiers. In this paper, we develop an adaptive resource control system that dynamically adjusts the resource shares to individual tiers in order to meet application-level QoS goals while achieving high resource utilization in the data center. Our control system is developed using classical control theory, and we used a black-box system modeling approach to overcome the absence of first principle models for complex enterprise applications and systems. To evaluate our controllers, we built a testbed simulating a virtual data center using Xen virtual machines. We experimented with two multi-tier applications in this virtual data center: a two-tier implementation of RUBiS, an online auction site, and a two-tier Java implementation of TPC-W. Our results indicate that the proposed control system is able to maintain high resource utilization and meets QoS goals in spite of varying resource demands from the applications.