ComputingCloud ComputingComputer ScienceCloud ArchitectureCloud InfrastructureMachine LearningAnomaly DetectionCloud Resource ManagementAccuracyCloud Infrastructure ManagementLead TimeSelf-organizing MapsSelf-organizing NetworksStatistical Learning TheoryTraining Data LabelingUnsupervised Anomaly Detection
Infrastructure-as-a-Service (IaaS) clouds are prone to performance anomalies due to their complex nature. Although previous work has shown the effectiveness of using statistical learning to detect performance anomalies, existing schemes often assume labelled training data, which requires significant human effort and can only handle previously known anomalies. We present an Unsupervised Behavior Learning (UBL) system for IaaS cloud computing infrastructures. UBL leverages Self-Organizing Maps to capture emergent system behaviors and predict unknown anomalies. For scalability, UBL uses residual resources in the cloud infrastructure for behavior learning and anomaly prediction with little add-on cost. We have implemented a prototype of the UBL system on top of the Xen platform and conducted extensive experiments using a range of distributed systems. Our results show that UBL can predict performance anomalies with high accuracy and achieve sufficient lead time for automatic anomaly prevention. UBL supports large-scale infrastructure-wide behavior learning with negligible overhead.
31
Colin Goodall, Ian T. Jolliffe · Technometrics · 1988 · 8.7K citations
Xen and the art of virtualization
Paul Barham, Boris Dragovic, Keir Fraser et al. · ACM SIGOPS Operating Systems Review · 2003 · 5.9K citations
Live migration of virtual machines
Christopher J. Clark, Keir Fraser, Steven Hand et al. · 2005 · 2.6K citations
Xen and the art of virtualization
Paul Barham, Boris Dragovic, Keir Fraser et al. · 2003 · 2.1K citations