Black-box and gray-box strategies for virtual machine migration

TLDR

Virtualization enables significant data‑center benefits by allowing virtual machine migration to eliminate hotspots. We present Sandpiper, a system that automates monitoring and detecting hotspots, maps resources, and initiates migrations. Sandpiper employs a black‑box, OS‑agnostic method and a gray‑box, statistics‑driven method, implemented in Xen and evaluated with CPU, network, and memory‑intensive workloads. Sandpiper resolves single‑server hotspots in under 20 seconds, scales to large data‑center environments, and the gray‑box approach improves decision‑making under memory pressure.

Abstract

Virtualization can provide significant benefits in data centers by enabling virtual machine migration to eliminate hotspots. We present Sandpiper, a system that automates the task of monitoring and detecting hotspots, determining a new mapping of physical to virtual resources and initiating the necessary migrations. Sandpiper implements a black-box approach that is fully OS- and application-agnostic and a gray-box approach that exploits OS- and application-level statistics. We implement our techniques in Xen and conduct a detailed evaluation using a mix of CPU, network and memory-intensive applications. Our results show that Sandpiper is able to resolve single server hotspots within 20 seconds and scales well to larger, data center environments. We also show that the gray-box approach can help Sandpiper make more informed decisions, particularly in response to memory pressure.