2012 · 60 citations · 20 references
EducationSystems EngineeringFault-tolerant ComputingTest ConstructionTest DevelopmentComputer-based TestingSoftware TestingFault PropagationFault Propagation AnalysisMutation TestingTest AutomationTest GenerationTest Oracles
In testing, the test oracle is the artifact that determines whether an application under test executes correctly. The choice of test oracle can significantly impact the effectiveness of the testing process. However, despite the prevalence of tools that support the selection of test inputs, little work exists for supporting oracle creation. In this work, we propose a method of supporting test oracle creation. This method automatically selects the oracle data — the set of variables monitored during testing — for expected value test oracles. This approach is based on the use of mutation analysis to rank variables in terms of fault-finding effectiveness, thus automating the selection of the oracle data. Experiments over four industrial examples demonstrate that our method may be a cost-effective approach for producing small, effective oracle data, with fault finding improvements over current industrial best practice of up to 145.8% observed.
20
A Greedy Heuristic for the Set-Covering Problem
Vašek Chvátal · Mathematics of Operations Research · 1979 · 2.6K citations
Is mutation an appropriate tool for testing experiments?
James H. Andrews, Lionel Briand, Yvan Labiche · 2005 · 787 citations