Analyzing regression test selection techniques

TLDR

Regression testing is a costly yet essential maintenance activity, and regression test selection techniques reuse existing tests to assess modified programs, but the diversity of goals among many proposed techniques makes comparison and evaluation difficult. The paper proposes a framework based on key issues to evaluate regression test selection techniques. The authors apply this framework to assess existing regression test selection techniques. The evaluation reveals strengths and weaknesses of current techniques and highlights problems that future work should address.

Abstract

Regression testing is a necessary but expensive maintenance activity aimed at showing that code has not been adversely affected by changes. Regression test selection techniques reuse tests from an existing test suite to test a modified program. Many regression test selection techniques have been proposed, however, it is difficult to compare and evaluate these techniques because they have different goals. This paper outlines the issues relevant to regression test selection techniques, and uses these issues as the basis for a framework within which to evaluate the techniques. The paper illustrates the application of the framework by using it to evaluate existing regression test selection techniques. The evaluation reveals the strengths and weaknesses of existing techniques, and highlights some problems that future work in this area should address.