An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers.

The Measurement of Observer Agreement for Categorical Data

J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 76.3K citations · Full text

Engineering, Generalizability Theory, Diagnosis +20

A Coefficient of Agreement for Nominal Scales

Jacob Cohen · Educational and Psychological Measurement · 1960 · 40.1K citations

Natural Language Processing, Engineering, Language Corpus +6

Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.

Jacob Cohen · Psychological Bulletin · 1968 · 8.3K citations

Scaled Disagreement, Engineering, Generalizability Theory +17

Measuring nominal scale agreement among many raters.

Joseph L. Fleiss · Psychological Bulletin · 1971 · 8.3K citations

Reliability, Survey (Human Research), Engineering +6

Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages

Quinn McNemar · Psychometrika · 1947 · 4.1K citations