Educational and Psychological Measurement · 2010 · 72 citations · 13 references
EducationEducational AssessmentEducational MeasurementItem Response TheoryPerformance MeasurementTest DevelopmentAdaptive Experimental DesignsAdaptive TestingComputer-based TestingItem AnalysisTest AdministrationVariance ReductionAdaptive Hypothesis TestingAdaptive Testing ModelsError ReductionPosterior Predictive P-valuesPosterior Variance EstimationPrecision MeasurementStandard Error EstimationStopping Rule Evaluation
The goal of the current study was to introduce a new stopping rule for computerized adaptive testing. The predicted standard error reduction stopping rule (PSER) uses the predictive posterior variance to determine the reduction in standard error that would result from the administration of additional items. The performance of the PSER was compared to that of the minimum standard error stopping rule and a modified version of the minimum information stopping rule in a series of simulated adaptive tests, drawn from a number of item pools. Results indicate that the PSER makes efficient use of CAT item pools, administering fewer items when predictive gains in information are small and increasing measurement precision when information is abundant.
13