Open-Ended Versus Multiple-Choice Response Formats—It Does Make a Difference for Diagnostic Purposes

Abstract

The purpose of the present study was to examine the effect of response format—open-ended (OE) versus multiple-choice (Me)—on the diagnosis of examinee misconceptions in a procedural task. A test in fraction addition arithmetic was administered to 285 eighth- grade students, 148 of whom responded to the OE ver sion of the test and 137 to the MC version. The two datasets were compared with respect to the underlying structure of the test, the number of different error types, and the diagnosed sources of misconception (bugs) reflected in the response patterns. The overall results indicated considerable differences between the two formats, with more favorable results for the OE format.