Journal of Hand Surgery (European Volume) · 2022 · 12 citations · 23 references
MedicineOrthopaedic SurgeryOrthopedic SurgeryGeneral SurgeryOrthopedicsPhysical ExaminationCongenital AnomaliesCongenital Hand AnomaliesCongenital Limb DeformitiesCongenital Orthopedic DisordersAssessment Of Congenital AnomaliesCongenital Upper Extremity AnomaliesCongenital Upper Limb AnomaliesInter-rater AgreementInter-rater ReliabilityInter-rater Reliability AssessmentInterobserver Reliability AssessmentInterrater Reliability
On two occasions, five surgeons classified a cohort of 150 consecutive patients with congenital upper limb anomalies according to the Oberg–Manske–Tonkin classification (2020 update). We estimated reliability for the main anomaly code by means of Cohen’s kappa (Κ) for ten rater pairs for five common and easily distinguishable anomalies (Group 1), and for all the other anomalies (Group 2). Inter-rater reliability for all patients ( n = 150) was substantial, almost perfect for Group 1 ( n = 64), but only moderate for Group 2 ( n = 86). Intra-rater reliability was higher for all groups. We suggest simplifications to the Oberg–Manske–Tonkin classification and highlight specific requirements for instructions to increase its reliability. Level of evidence: I
23
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Interrater reliability: the kappa statistic
Marry L. McHugh · Biochemia Medica · 2012 · 18.6K citations · Full text
Interrater reliability: the kappa statistic.
Mary L. McHugh · PubMed · 2012 · 9.2K citations · Full text