2013 · 14 citations · 25 references
ComputingComputer ScienceComputer SystemsDistributed SystemsFault-tolerant SystemsSoftware EngineeringDistributed DebuggingFault DetectionFault DiagnosisMetrics CollectionSoftware MetricsAnomaly Detection For DebuggingAutomated DebuggingBug LocalizationDebugging TechniquesDistributed System DebuggingDistributed Systems DebuggingPerformance ProfilingTime Windows
Debugging today's large-scale distributed applications is complex. Traditional debugging techniques such as breakpoint-based debugging and performance profiling require a substantial amount of domain knowledge and do not automate the process of locating bugs and performance anomalies. We present Orion, a framework to automate the problem-localization process in distributed applications. From a large set of metrics, Orion intelligently chooses important metrics and models the application's runtime behavior through pair wise correlations of those metrics in the system, within multiple non-overlapping time windows. When correlations deviate from those of a learned correct model due to a bug, our analysis pinpoints the metrics and code regions (class and method within it) that are most likely associated with the failure. We demonstrate our framework with several real-world failure cases in distributed applications such as: HBase, Hadoop DFS, a campus-wide Java application, and a regression testing framework from IBM. Our results show that Orion is able to pinpoint the metrics and code regions that developers need to concentrate on to fix the failures.
25
Detecting large-scale system problems by mining console logs
Wei Xu, Ling Huang, Armando Fox et al. · 2009 · 1.3K citations
Susan L. Graham, Peter B. Kessler, Marshall Kirk McKusick · 1982 · 978 citations
Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis
Qiang Fu, Jian–Guang Lou, Yi Wang et al. · 2009 · 557 citations
X-trace: a pervasive network tracing framework
Rodrigo Fonseca, George Porter, Randy H. Katz et al. · 2007 · 408 citations