Reliability for the Law of Comparative Judgment

Abstract

A variance-components analysis is presented for paired comparisons in terms of three components: s , the scale value of the stimuli; d , a deviation from the linear model specified by the law of comparative judgment; and b , a binomial error component. Estimates are given for each of the three variances, σ s 2 , σ d 2 , and σ b 2 . Several coefficients, analogous to reliability coefficients, based on these three variances are indicated. The techniques are illustrated in a replicated comparison of handwriting specimens.