Applied Measurement in Education · 2005 · 29 citations · 26 references
EducationPsychologyPerformance MeasurementPsychometricsStandard-settingStandard-setting ReliabilityStandard-setting ValidityEmpirical EvaluationExploratory Case StudyStandard Setting PanelsStandard-setting EffectsStandard-setting ProcessesStandard-setting Study DesignStandard-setting ValidationStandard-setting Validity Evidence
Standard-setting research has relied very heavily on certain types of information that, although helpful, may be inadequate for judging the quality of standard-setting results. To increase confidence in standard-setting results, the measurement community must understand far more about the panelists' task and about the factors that influence their decisions. Further, the measurement community may be overlooking important sources of data and types of research that could be useful in understanding these processes. To illustrate 1 such type of data, this article will present findings from an exploratory qualitative study of 2 standard-setting meetings. These findings are intended simply to support the potential of such studies to shed light on the standard-setting process. This article is thus to be understood not as an empirical study but as an argument supported by illustrative data, presented within a framework of standard-setting validity.
26
Lorrie A. Shepard · Review of Research in Education · 1993 · 468 citations
Gene V. Glass · Journal of Educational Measurement · 1978 · 311 citations