2012 · 49 citations · 16 references
EducationEducational AssessmentEducational MeasurementPsychometricsScale DevelopmentTest DevelopmentItem AnalysisProblem-solving AssessmentProblem-solving StrategiesPsychological AssessmentPsychological TestingTest ValidityAssessment Of Problem-solving SkillsComplex Problem SolvingComplex Problem Solving AssessmentConstruct ValidityInstrument ValidityNumerical ReasoningPsychometric PropertiesPsychometric Test Construction
Computer-based problem solving scenarios or “microworlds” are contemporary assessment instruments frequently used to assess students’ complex problem solving behavior – a key aspect of today’s educational curricula and assessment frameworks. Surprisingly, almost nothing is known about their (1) acceptance or (2) psychometric characteristics in student populations. This article introduces the Genetics Lab (GL), a newly developed microworld, and addresses this lack of empirical data in two studies. Findings from Study 1, with a sample of 61 ninth graders, show that acceptance of the GL was high and that the internal consistencies of the scores obtained were satisfactory. In addition, meaningful intercorrelations between the scores supported the instrument’s construct validity. Study 2 drew on data from 79 ninth graders in differing school types. Large to medium correlations with figural and numerical reasoning scores provided evidence for the instrument’s construct validity. In terms of external validity, substantial correlations were found between academic performance and scores on the GL, most of which were higher than those observed between academic performance and the reasoning scales administered. In sum, this research closes an important empirical gap by (1) proving acceptance of the GL and (2) demonstrating satisfactory psychometric properties of its scores in student populations.
16
The Cambridge handbook of multimedia learning
Richard E. Mayer · Choice Reviews Online · 2006 · 2.3K citations
The Problem of Units and the Circumstance for POMP
Patricia Cohen, Jacob Cohen, Leona S. Aiken et al. · Multivariate Behavioral Research · 1999 · 911 citations