1000 Islands: Integrated Capacity and Workload Management for the Next Generation Data Center

TLDR

Recent advances in hardware and software virtualization provide unprecedented capabilities for mapping virtual resources to physical resources. The paper seeks to create a service‑hosting abstraction that lets application owners focus on SLOs by delivering a resource‑management solution that meets those SLOs for many applications amid changing data‑center conditions while hiding complexity from both owners and operators. The authors present an automated capacity and workload management system that integrates multiple resource controllers across three scopes and time scales. Simulations and experiments demonstrate that the integrated solution uses data‑center resources efficiently and reduces service‑level violations for high‑priority applications.

Abstract

Recent advances in hardware and software virtualization offer unprecedented management capabilities for the mapping of virtual resources to physical resources. It is highly desirable to further create a "service hosting abstraction" that allows application owners to focus on service level objectives (SLOs) for their applications. This calls for a resource management solution that achieves the SLOs for many applications in response to changing data center conditions and hides the complexity from both application owners and data center operators. In this paper, we describe an automated capacity and workload management system that integrates multiple resource controllers at three different scopes and time scales. Simulation and experimental results confirm that such an integrated solution ensures efficient and effective use of data center resources while reducing service level violations for high priority applications.