Journal of Educational Measurement · 1993 · 59 citations · 7 references
EducationEducational AssessmentEducational MeasurementItem Response TheoryPsychometricsTest DevelopmentItem AnalysisItem Characteristic CurvesTest Information FunctionsTest TheoryTest ValidityAptitude Test DevelopmentAptitude Test ValidationAptitude Test ValidityEducational AptitudeItem Response FunctionItem Response Theory Analysis
Item response models are finding increasing use in achievement and aptitude test development. Item response theory (IRT) test development involves the selection of test items based on a consideration of their item information functions. But a problem arises because item information functions are determined by their item parameter estimates, which contain error. When the “best” items are selected on the basis of their statistical characteristics, there is a tendency to capitalize on chance due to errors in the item parameter estimates. The resulting test, therefore, falls short of the test that was desired or expected. The purposes of this article are (a) to highlight the problem of item parameter estimation errors in the test development process, (b) to demonstrate the seriousness of the problem with several simulated data sets, and (c) to offer a conservative solution for addressing the problem in IRT‐based test development.
7
Statistical Theories of Mental Test Scores
William W. Rozeboom, Frederic M. Lord, Melvin R. Novick et al. · American Educational Research Journal · 1969 · 8.1K citations
Lloyd G. Humphreys, E. F. Lindquist · The American Journal of Psychology · 1952 · 1.5K citations