Observer Homogeneity in the Histologic Diagnosis of<i>Helicobacter pylori</i>: Latent Class Analysis, Kappa Coefficient, and Repeat Frequency

Abstract

Four pathologists independently examined 82 antral mucosal biopsy specimens for the presence of Helicobacter pylori and indicated whether their assessments were certain. The pathologists made a positive diagnosis in from 56% to 84% of the specimens (significant heterogeneity, p < 0.01). The frequency of uncertain diagnoses was from 4% to 20% (p < 0.01). Uncertain statements occurred more frequently among negative than among positive diagnoses. For the six pairs of observers the kappa coefficients were between 0.39 and 0.82. By a latent class analysis measures of diagnostic accuracy were calculated comparing the observers' assessments with an estimated consensus diagnosis. The predictive values of a positive diagnosis ranged from 0.70 to 1.00. By calculation of repeat frequencies--that is, the probability that an observer's statement was confirmed by another observer--it became evident that uncertain statements were less frequently (61%) confirmed than were certain ones (85%). It is concluded that observer homogeneity is only moderate with regard to the histologic diagnosis of H. pylori, which should be considered both in daily clinical routine and in scientific studies. Disagreement between observers was associated with negative diagnoses, presumably because the pathologists felt more uncertain in these cases.