Research in Nursing & Health · 1990 · 50 citations · 9 references
EducationEducational AssessmentFormative AssessmentHealth AssessmentPerformance MeasurementClinical Performance AssessmentHealth Care Performance MeasurementHealthcare Performance MeasurementReliabilityTest ReliabilityAssessment ReliabilityAssessor ReliabilityClinical Measurement ReliabilityInter-rater ReliabilityInterrater ReliabilityReliability AssessmentReliability Of Performance AssessmentTraining
Although the process of rater training is important for establishing interrater reliability of observational instruments, there is little information available in current literature to guide the researcher. In this article, principles and procedures that can be used when rater performance is a critical element of reliability assessment are described. Three phases of the process of rater training are presented: (a) training raters to use the instrument; (b) evaluating rater performance at the end of training; and (c) determining the extent to which rater training is maintained during a reliability study. An example is presented to illustrate how these phases were incorporated in a study to examine the reliability of a measure of patient intensity called the Patient Intensity for Nursing Index (PINI).
9
Handbook of research methods in clinical psychology
Choice Reviews Online · 2003 · 697 citations
Another look at interrater agreement.
Rebecca Zwick · Psychological Bulletin · 1988 · 226 citations
Three Estimates of Interrater Reliability for Nominal Data
Margaret Topf · Nursing Research · 1986 · 137 citations