European Radiology · 2021 · 39 citations · 17 references
MedicineOrthopedic SurgeryRadiologyDiagnostic ImagingDiagnostic RadiologyOrthopedicsFracture DetectionFracture EvaluationMusculoskeletal RadiographyMusculoskeletal RadiologyRadiographic AssessmentAutomatic ClassificationClassification ModelsConvolutional Neural Network DetectionConvolutional Neural NetworksDeep Learning In RadiologyFracture ClassificationLabelsRadiographic Classification
OBJECTIVES: To evaluate the performance of a deep convolutional neural network (DCNN) in detecting and classifying distal radius fractures, metal, and cast on radiographs using labels based on radiology reports. The secondary aim was to evaluate the effect of the training set size on the algorithm's performance. METHODS: A total of 15,775 frontal and lateral radiographs, corresponding radiology reports, and a ResNet18 DCNN were used. Fracture detection and classification models were developed per view and merged. Incrementally sized subsets served to evaluate effects of the training set size. Two musculoskeletal radiologists set the standard of reference on radiographs (test set A). A subset (B) was rated by three radiology residents. For a per-study-based comparison with the radiology residents, the results of the best models were merged. Statistics used were ROC and AUC, Youden's J statistic (J), and Spearman's correlation coefficient (ρ). RESULTS: The models' AUC/J on (A) for metal and cast were 0.99/0.98 and 1.0/1.0. The models' and residents' AUC/J on (B) were similar on fracture (0.98/0.91; 0.98/0.92) and multiple fragments (0.85/0.58; 0.91/0.70). Training set size and AUC correlated on metal (ρ = 0.740), cast (ρ = 0.722), fracture (frontal ρ = 0.947, lateral ρ = 0.946), multiple fragments (frontal ρ = 0.856), and fragment displacement (frontal ρ = 0.595). CONCLUSIONS: The models trained on a DCNN with report-based labels to detect distal radius fractures on radiographs are suitable to aid as a secondary reading tool; models for fracture classification are not ready for clinical use. Bigger training sets lead to better models in all categories except joint affection. KEY POINTS: • Detection of metal and cast on radiographs is excellent using AI and labels extracted from radiology reports. • Automatic detection of distal radius fractures on radiographs is feasible and the performance approximates radiology residents. • Automatic classification of the type of distal radius fracture varies in accuracy and is inferior for joint involvement and fragment displacement.
17
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Fracture and Dislocation Classification Compendium—2018
E.G. Meinberg, Julie Agel, CS Roberts et al. · Journal of Orthopaedic Trauma · 2017 · 2.6K citations
Deep neural network improves fracture detection by clinicians
Robert Lindsey, Aaron Daluiski, Sumit Chopra et al. · Proceedings of the National Academy of Sciences · 2018 · 617 citations · Full text
Artificial intelligence for analyzing orthopedic trauma radiographs
Jakub Olczak, Niklas Fahlberg, Atsuto Maki et al. · Acta Orthopaedica · 2017 · 465 citations · Full text