2011 · 60 citations · 27 references
ComputingComputer ScienceDiagnostic ReasoningDocumentationSoftware EngineeringFailure AnalysisSoftware DocumentationSoftware TestingAutomated Test GenerationDebuggingDebugging SupportDebugging TechniquesEnd-user DebuggingSoftware Failure AnalysisUser Study Evaluation
A failed test reveals a potential bug in the tested code. Developers need to understand which parts of the test are relevant to the failure before they start bug-fixing. This paper presents a fully-automated technique (and its tool implementation, called FailureDoc) to explain a failed test. FailureDoc augments the failed test with explanatory documentation in the form of code comments. The comments indicate changes to the test that would cause it to pass, helping programmers understand why the test fails. We evaluated FailureDoc on five real-world programs. FailureDoc generated meaningful comments for most of the failed tests. The inferred comments were concise and revealed important debugging clues. We further conducted a user study. The results showed that FailureDoc is useful in bug diagnosis.
27
Mark Weiser · IEEE Transactions on Software Engineering · 1984 · 3.2K citations
Scalable statistical bug isolation
Ben Liblit, Mayur Naik, Alice X. Zheng et al. · ACM SIGPLAN Notices · 2005 · 736 citations