Medical Physics · 2022 · 21 citations · 38 references
MedicineOncologyRadiologyDiagnostic ImagingDiagnostic RadiologyMachine LearningCancer DetectionComputed TomographyImage FusionMedical Image AnalysisMedical ImagingMultimodal ImagingComputed Tomography Image FusionGround-glass Nodule AssessmentGround-glass Nodule EvaluationMedical Image FusionMultilayer PerceptronMultimodal Data FusionMultimodal FusionMultimodal Imaging Fusion
PURPOSE: To develop a novel multimodal data fusion model by incorporating computed tomography (CT) images and clinical variables based on deep learning for predicting the invasiveness risk of stage I lung adenocarcinoma that manifests as ground-glass nodules (GGNs) and compare the diagnostic performance of it with that of radiologists. METHODS: A total of 1946 patients with solitary and histopathologically confirmed GGNs with maximum diameter less than 3 cm were retrospectively enrolled. The training dataset containing 1704 GGNs was augmented by resampling, scaling, random cropping, and so forth, to generate new training data. A multimodal data fusion model based on residual learning architecture and two multilayer perceptron with attention mechanism combining CT images with patient general data and serum tumor markers was built. The distance-based confidence scores (DCS) were calculated and compared among multimodal data models with different combinations. An observer study was conducted and the prediction performance of the fusion algorithms was compared with that of the two radiologists by an independent testing dataset with 242 GGNs. RESULTS: (81.9%), and Matthews correlation coefficient (73.2%) for classifying between IA and non-IA GGNs, which was even better than the senior radiologist's performance (accuracy, 86.1%). In addition, the DCSs for multimodal data suggested that CT image had a stronger influence (0.9540) quantitatively than general data (0.6726) or tumor marker (0.6971). CONCLUSION: This study demonstrated that the feasibility of integrating different types of data including CT images and clinical variables, and the multimodal data fusion model yielded higher performance for distinguishing IA from non-IA GGNs.
38
Rebecca L. Siegel, Kimberly D. Miller, Ahmedin Jemal · CA A Cancer Journal for Clinicians · 2019 · 21K citations · Full text
Cancer statistics in China, 2015
Wanqing Chen, Rongshou Zheng, Peter D. Baade et al. · CA A Cancer Journal for Clinicians · 2016 · 18K citations · Full text
Residual Attention Network for Image Classification
Fei Wang, Mengqing Jiang, Chen Qian et al. · 2017 · 3.8K citations