ETS Research Report Series · 1995 · 42 citations · 4 references
EducationEducational MeasurementPsychologyDiagnostic AssessmentPsychometricsTest DevelopmentComputer-based TestingDiagnostic Test EvaluationMethod ComparisonScore ComparabilityTest EquatingTest ValidityComputerized Adaptive ScoringTest Form ComparabilityTest Score Comparability
The study evaluates the comparability of computer‑based and computer‑adaptive GRE General Test scores and investigates adjustments to restore comparability for the analytical measure. A second study collected statistics on the analytical measure and equated analytical CAT scores to CBT scores to adjust for paradigm differences. Verbal and quantitative CAT scores matched CBT scores, while analytical CAT scores initially differed; after equating, new conversions yielded comparable analytical CAT and CBT scores.
ABSTRACT This report summarizes the results from two studies. The first study assessed the comparability of scores derived from linear computer‐based (CBT) and computer adaptive (CAT) versions of the three GRE General Test measures. The verbal and quantitative CATs were found to produce scores that were comparable to their CBT counterparts. However, the analytical CAT produced scores that were judged not to be comparable to the analytical CBT scores. As a result, a second study was performed to further examine the analytical measure to ascertain the extent of the lack of comparability and to obtain statistics that would permit adjustments to restore comparability. Results of the additional study of the analytical measure indicated that the differences in analytical CAT and CBT scores due to the testing paradigm were large enough to require an adjustment in scores. Therefore, in order to enhance the comparability of analytical CAT and CBT scores, the analytical CAT was equated to the analytical CBT. This equating provided new analytical CAT conversions that resulted in comparable analytical CAT and CBT scores.
4
FIELD TEST OF A COMPUTER‐BASED GRE GENERAL TEST
Gary A. Schaeffer, Clyde M. Reese, Manfred Steffen et al. · ETS Research Report Series · 1993 · 49 citations · Full text