International Journal of Research & Method in Education · 2009 · 57 citations · 24 references
EducationEducational AssessmentMathematicsAssessment DesignCriterion-referenced AssessmentFormative AssessmentStandards AlignmentStandards-based AssessmentTeacher EvaluationAlignment Of CriteriaAssessment Alignment AnalysisBloom's Taxonomy AlignmentStandards-based AlignmentStandards-based Teacher Assessment
In education, standards must be interpreted for teaching, assessment, and alignment, yet studies on consistency among judges are lacking. The study evaluated the usefulness of Bloom’s revised taxonomy for interpreting mathematics standards using multiple criteria. Researchers applied the taxonomy to mathematics standards and compared interpretations between teachers and assessment experts. Results showed the taxonomy was acceptable, but teachers and assessment experts differed, with experts demonstrating greater consistency.
In education, standards have to be interpreted, for planning of teaching, for development of assessments and for alignment analysis. In most cases, it is important that there is an agreement between individuals and organizations about how to interpret standards. However, there is a lack of studies of how consistent different group of judges are when interpreting standards. In this study, the usefulness of Bloom's revised taxonomy for interpreting standards in mathematics is evaluated, using different criteria. The results indicate that the taxonomy is an acceptable tool. The results also indicate that there are differences between the panel composed of teachers and the panel composed of assessment experts. The assessment experts were more consistent in their interpretation of standards. Limitations of the study and requirements for alignment analysis are discussed.
24
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Types and qualities of knowledge
Ton de Jong, Monica G. M. Ferguson‐Hessler · Educational Psychologist · 1996 · 717 citations · Full text