Physical Therapy · 1994 · 645 citations · 15 references
MedicineKinesiologyRehabilitation MedicineOrthopedicsPhysiatryPhysical TherapyJoint Motion AnalysisOrthopedic ExaminationPhysical RehabilitationTest ReliabilityClinical Measurement ReliabilityGoniometric MeasurementInter-rater ReliabilityInter-rater Reliability AssessmentInterrater ReliabilityReliability Of Biomechanical MeasurementsSample Size CalculationStandard Error Estimation
When assessing both interrater and intrarater reliability, a repeated‑measure design should be used to increase precision, and reliability coefficients should be accompanied by appropriate statistical tests, confidence intervals, and standard error of measurement. Statistical methodology for the concurrent assessment of interrater and intrarater reliability is presented. The authors illustrate the methodology with a therapist using two goniometers to repeatedly measure knee joint angles, and provide procedures for estimating reliability coefficients, testing hypotheses, constructing confidence intervals, computing sample size requirements, and calculating and interpreting the standard error of measurement.
Statistical methodology for the concurrent assessment of interrater and intrarater reliability is presented. Application of the methodology is illustrated with an example of one therapist using two goniometers repeatedly to measure knee joint angles. Methods for estimating the coefficients, testing hypotheses, constructing confidence intervals, and computing sample size requirements are provided. In addition, the calculation and clinical interpretation of the standard error of measurement (SEM) are discussed. It is recommended that (1) when both interrater and intrarater reliability are being assessed, a repeated-measures design be used to take advantage of the increased precision gained by using all observations in the statistical analysis, and (2) appropriate statistical tests, confidence intervals, and SEMs always be used in conjunction with the estimated reliability coefficients.
15
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Applied Linear Statistical Models
Michael Kutner · Technometrics · 1997 · 7.3K citations · Full text
Henry Scheffé · Soil Science · 1960 · 5.6K citations