2019 · 44 citations · 74 references
ComputingComputer EngineeringComputer ScienceFormal MethodsNatural Language ProcessingSoftware EngineeringSoftware DesignSoftware TestingSpecification LanguagesTest SpecificationAutomated Bug FindingAutomated Test GenerationExceptional ScenariosSpecification-based TestingTest Oracles
Software specifications often use natural language to describe the desired behavior, but such specifications are difficult to verify automatically. We present Swami, an automated technique that extracts test oracles and generates executable tests from structured natural language specifications. Swami focuses on exceptional behavior and boundary conditions that often cause field failures but that developers often fail to manually write tests for. Evaluated on the official JavaScript specification (ECMA-262), 98.4% of the tests Swami generated were precise to the specification. Using Swami to augment developer-written test suites improved coverage and identified 1 previously unknown defect and 15 missing JavaScript features in Rhino, 1 previously unknown defect in Node.js, and 18 semantic ambiguities in the ECMA-262 specification.
74
The Stanford CoreNLP Natural Language Processing Toolkit
Christopher D. Manning, Mihai Surdeanu, John Bauer et al. · 2014 · 7.2K citations · Full text
A Survey on Software Fault Localization
W. Eric Wong, Ruizhi Gao, Yihao Li et al. · IEEE Transactions on Software Engineering · 2016 · 1.1K citations