Ophthalmology Retina · 2021 · 82 citations · 27 references
MedicineOphthalmologyVision ScienceClinical Vision ScienceOcular DiseaseOcular ImagingAge-related Macular DegenerationMacular DegenerationMacular DiseaseMacular DisordersRetinal DegenerationRetinal PathologyAge-related Macular Degeneration DiagnosisAge-related Macular Degeneration GradingAgreement CoefficientOuter Retinal AtrophyOuter Retinal ChangesRetinal Disease GradingRetinal Image GradingRpe Atrophy
To determine the interreader agreement for incomplete retinal pigment epithelium (RPE) and outer retinal atrophy (iRORA) and complete RPE and outer retinal atrophy (cRORA) and their related features in age-related macular degeneration (AMD). Interreader agreement study. Twelve readers from 6 reading centers. After formal training, readers qualitatively assessed 60 OCT B-scans from 60 eyes with AMD for 9 individual features associated with early atrophy and performed 7 different annotations to quantify the spatial extent of OCT features within regions of interest. The qualitative and quantitative features were used to derive the presence of iRORA and cRORA and also in an exploratory analysis to examine if agreement could be improved using different combinations of features to define OCT atrophy. Interreader agreement based on Gwet’s first-order agreement coefficient (AC1) for qualitatively graded OCT features and classification of iRORA and cRORA, and smallest real difference (SRD) for quantitatively graded OCT features. Substantial or better interreader agreement was observed for all qualitatively graded OCT features associated with atrophy (AC1 = 0.63–0.87), except for RPE attenuation (AC1 = 0.46) and disruption (AC1 = 0.26). The lowest SRD for the quantitatively graded horizontal features was observed for the zone of choroidal hypertransmission (± 190.8 μm). Moderate agreement was found for a 3-category classification of no atrophy, iRORA, and cRORA (AC1 = 0.53). Exploratory analyses suggested a significantly higher level of agreement for a 3-category classification using (1) no atrophy; (2) presence of inner nuclear layer and outer plexiform layer subsidence, or a hyporeflective wedge-shaped band, as a less severe atrophic grade; and (3) the latter plus an additional requirement of choroidal hypertransmission of 250 μm or more for a more severe atrophic grade (AC1 = 0.68; P = 0.013). Assessment of iRORA and cRORA, and most of their associated features, can be performed relatively consistently and robustly. A refined combination of features to define early atrophy could further improve interreader agreement.
27
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Consensus Definition for Atrophy Associated with Age-Related Macular Degeneration on OCT
Srinivas R. Sadda, Robyn H. Guymer, Frank G. Holz et al. · Ophthalmology · 2017 · 872 citations · Full text