American Journal of Roentgenology · 1999 · 145 citations · 12 references
MedicineRadiologyDiagnostic ImagingDiagnostic RadiologyUltrasonographyBreast AssessmentBreast ImagingBreast Lesion CharacterizationBreast UltrasonographyBreast UltrasoundMedical ImagingBreast Imaging FindingsBreast Imaging LexiconBreast Lesion DiagnosisBreast Mass AssessmentDiagnostic Breast UltrasoundKappa StatisticSolid LesionsSolid Mass Evaluation
OBJECTIVE: The purpose of this study was to measure the level of inter- and intraobserver agreement and to evaluate the causes of variability in radiologists' descriptions and assessments of sonograms of solid breast masses. MATERIALS AND METHODS: Sixty sonograms of solid masses were evaluated independently by five radiologists. Observers used the lexicon of a recently published benchmark report on sonographic appearances of breast masses to determine mass shape, margin, echogenicity, echo texture, presence of echogenic pseudocapsule, and acoustic transmission. Final diagnostic assessments were determined by applying the rule-based model of the same benchmark report to the radiologists' descriptions. In addition, one observer interpreted each case twice to evaluate intraobserver variability. Inter- and intraobserver variability were measured using Cohen's kappa statistic. We also investigated causes of variability in radiologists' descriptions. RESULTS: Interobserver agreement ranged from lowest for determining the presence of an echogenic pseudocapsule (kappa = .09) to highest for determining mass shape (kappa = .8). Intraobserver agreement was lowest for mass echo texture (kappa = .24) and greatest for mass shape (kappa = .79). Variability in descriptions of lesions contributed to interobserver (kappa = .51) and some intraobserver (kappa = .66) inconsistency in assessing the likelihood of malignancy. CONCLUSION: Lack of uniformity among observers' use of descriptive terms for solid breast masses resulted in inconsistent diagnoses. The need for improved definitions and additional illustrative examples could be addressed by developing a standardized lexicon similar to that of the Breast Imaging Reporting and Data System.
12
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Solid breast nodules: use of sonography to distinguish between benign and malignant lesions.
A. Thomas Stavros, David Thickman, Cindy Rapp et al. · Radiology · 1995 · 1.8K citations
Breast Imaging Reporting and Data System
Wendie A. Berg, C Campassi, Patricia Langenberg et al. · American Journal of Roentgenology · 2000 · 1.3K citations
Reproducibility of histomorphologic diagnoses with special reference to the kappa statistic
Hans Svanholm, H Starklint, H.J.G. Gundersen et al. · Apmis · 1989 · 455 citations