Educational and Psychological Measurement · 2012 · 72 citations · 32 references
EducationEducational AssessmentEducational MeasurementDifferential Item FunctioningItem Response TheoryPsychometricsAnchor Item SelectionDimensionality AssessmentItem AnalysisPolytomous Item ModelsRanking TestsItem Response Theory DifPolytomous Differential Item FunctioningPolytomous Item Differential FunctioningRank-based ClassificationRank-based EstimationScale PurificationScore PurificationSimulation Studies
The DIF-free-then-DIF (DFTD) strategy consists of two steps: (a) select a set of items that are the most likely to be DIF-free and (b) assess the other items for DIF (differential item functioning) using the designated items as anchors. The rank-based method together with the computer software IRTLRDIF can select a set of DIF-free polytomous items very accurately, but it loses accuracy when tests contain many DIF items. To resolve this problem, the authors developed a new method by adding a scale purification procedure to the rank-based method and conducted two simulation studies to evaluate its performances on DIF assessment. It was found that the new method outperformed the rank-based method in identifying DIF-free items, especially when the tests contained many DIF items. In addition, the new method, combined with the DFTD strategy, yielded a well-controlled Type I error rate and a high power rate of DIF detection. In contrast, conventional DIF assessment methods yielded an inflated Type I error rate and a deflated power rate when the tests contained many DIF items favoring the same group. In conclusion, the simulation results support the new method and the DFTD strategy in DIF assessment.
32
Statistical Theories of Mental Test Scores
William W. Rozeboom, Frederic M. Lord, Melvin R. Novick et al. · American Educational Research Journal · 1969 · 8.1K citations
A Rasch Model for Partial Credit Scoring
Geoff N Masters · Psychometrika · 1982 · 3.8K citations
A Rating Formulation for Ordered Response Categories
David Andrich · Psychometrika · 1978 · 3K citations