Journal of Data Science · 2021 · 13 citations · 52 references
Public HealthBiostatisticsCategorical Data AnalysisDecision AnalysisPsychometricsClassificationContingency Table AnalysisData AnalysisData InterpretationLog-linear ModelsAgreement AnalysisAgreement StatisticsInter-rater AgreementInterrater AgreementInterrater ReliabilityKappa CoefficientKappa StatisticRater Agreement
In square contingency tables, analysis of agreement between row and column classifications is of interest. For nominal categories, kappa co- efficient is used to summarize the degree of agreement between two raters. Numerous extensions and generalizations of kappa statistics have been pro- posed in the literature. In addition to the kappa coefficient, several authors use agreement in terms of log-linear models. This paper focuses on the approaches to study of interrater agreement for contingency tables with nominal or ordinal categories for multiraters. In this article, we present a detailed overview of agreement studies and illustrate use of the approaches in the evaluation agreement over three numerical examples.
52
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text