Measuring Agreement for Multinomial Data

Abstract

A kappa-like statistic is proposed as a measure of agreement for a set of multinomial random variables arrayed in a two-way layout. This statistic is shown to arise either via the chancecorrection of a certain proportion of agreement or via an analysis of variance for a two-way layout. The asymptotic standard error is derived under the assumption of complete independence among the random variables.