2017 · 47 citations · 18 references
EducationComputer ScienceEducational AssessmentAssessment DesignFormative AssessmentSummative AssessmentComputer-based Science AssessmentConstructed-response AssessmentFeedback In Formative AssessmentFormative Assessment In ScienceQuestion AnsweringStudent AssessmentAssessmentsComputer Science PedagogyFeedback From Constructed ResponsesFormative Assessment QuestionsIncorrect Response AnalysisIntroductory Computer ScienceSelected-response Items
Constructed-response, code-tracing questions ("What would Python print?") are good formative assessments. Unlike selected-response questions simply marked correct or incorrect, a constructed wrong answer can provide information on a student's particular difficulty. However, constructed-response questions are resource-intensive to grade manually, and machine grading yields only correct/incorrect information. We analyzed incorrect constructed responses from code-tracing questions in an introductory computer science course to investigate whether a small subsample of such responses could provide enough information to make inspecting the subsample worth the effort, and if so, how best to choose this subsample. In addition, we sought to understand what insights into student difficulties could be gained from such an analysis.
18
Repair Theory: A Generative Theory of Bugs in Procedural Skills
John Seely Brown, Kurt VanLehn · Cognitive Science · 1980 · 546 citations · Full text