Thyroid · 2017 · 209 citations · 19 references
MedicineRadiologyDiagnostic ImagingUltrasonographyUltrasoundBenign Thyroid DiseaseComputer-aided DiagnosisThyroid ImagingThyroid UltrasonographyThyroid UltrasoundUltrasound ImagingBenign Thyroid Nodule ImagingComparative Diagnostic PerformanceComputer-aided Thyroid DiagnosisDiagnostic Performance MetricsInitial Patient AssessmentMalignant Thyroid Nodule ImagingThyroid Lesion DetectionThyroid Nodule Detection
BACKGROUND: An initial clinical assessment is described of a new, commercially available, computer-aided diagnosis (CAD) system using artificial intelligence (AI) for thyroid ultrasound, and its performance is evaluated in the diagnosis of malignant thyroid nodules and categorization of nodule characteristics. METHODS: Patients with thyroid nodules with decisive diagnosis, whether benign or malignant, were consecutively enrolled from November 2015 to February 2016. An experienced radiologist reviewed the ultrasound image characteristics of the thyroid nodules, while another radiologist assessed the same thyroid nodules using the CAD system, providing ultrasound characteristics and a diagnosis of whether nodules were benign or malignant. The diagnostic performance and agreement of US characteristics between the experienced radiologist and the CAD system were compared. RESULTS: In total, 102 thyroid nodules from 89 patients were included; 59 (57.8%) were benign and 43 (42.2%) were malignant. The CAD system showed a similar sensitivity as the experienced radiologist (90.7% vs. 88.4%, p > 0.99), but a lower specificity and a lower area under the receiver operating characteristic (AUROC) curve (specificity: 74.6% vs. 94.9%, p = 0.002; AUROC: 0.83 vs. 0.92, p = 0.021). Classifications of the ultrasound characteristics (composition, orientation, echogenicity, and spongiform) between radiologist and CAD system were in substantial agreement (κ = 0.659, 0.740, 0.733, and 0.658, respectively), while the margin showed a fair agreement (κ = 0.239). CONCLUSION: The sensitivity of the CAD system using AI for malignant thyroid nodules was as good as that of the experienced radiologist, while specificity and accuracy were lower than those of the experienced radiologist. The CAD system showed an acceptable agreement with the experienced radiologist for characterization of thyroid nodules.
19
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Hossein Gharib, Enrico Papini, Jeffrey R. Garber et al. · Endocrine Practice · 2016 · 1.3K citations
Benign and Malignant Thyroid Nodules: US Differentiation—Multicenter Retrospective Study
Won‐Jin Moon, So Lyung Jung, Jeong Hyun Lee et al. · Radiology · 2008 · 1.1K citations · Full text