An evaluation of the cognitive processes of programmers engaged in software debugging

TLDR

Software programmers at all experience levels engage in similar activities guided by search strategies. The study empirically evaluates and extends Hale and Haworth's cognitive processes model for software debugging, focusing on how programmers choose, implement, and evaluate debugging rules and strategies. The authors used verbal protocol analysis of staged debugging episodes to assess the hypothesized tasks and their sequence. Empirical evidence strongly supports Hale and Haworth's model, confirming that the hypothesized debugging tasks are accurate and complete, that programmers generate and evaluate hypotheses recursively, and that the model captures a goal‑driven, hierarchical control of debugging steps, though complex multi‑path sequences were not supported. © 1999 John Wiley & Sons, Ltd.

Abstract

This study empirically evaluates Hale and Haworth's cognitive processes model for programmers engaged in software debugging. They claim that across all levels of experience, software programmers engage in the same activities and follow a similar pattern of activities directed by search strategies. Verbal protocol analysis of data gathered during a staged problem-solving episode (e.g., fixing a hidden bug) was used to evaluate Hale and Haworth's hypothesized debugging tasks, as well as the hypothesized sequence in which the tasks are performed. Empirical support for Hale and Haworth's model was strong. Specifically, the set of hypothesized debugging tasks is both accurate and complete. Further, the model effectively represents the process by which programmers generate and evaluate hypotheses, and the manner in which programmers recursively attack a debugging problem. Unsupported are those complex debugging sequences involving multiple possible paths. This study extends the understanding of the mechanisms by which programmers choose, implement and evaluate debugging rules and strategies. Results verify that all observed programmers utilize a pattern of cognitive process steps as well as comprehension strategies to derive needed declarative knowledge. The results support a goal-driven model of program debuggers' cognitive processes depicting a hierarchy of levels with an inherent control structure that directs debugging process steps. Copyright © 1999 John Wiley & Sons, Ltd.