Diagnostics · 2022 · 77 citations · 22 references
ComputingComputer ScienceRadiologyComputer VisionDiagnostic ImagingMachine LearningBreast ImagingDeep LearningImage Feature EngineeringMedical Image AnalysisMedical ImagingRepresentation LearningBreast Lesion DiagnosisComputer-aided Tumor DiagnosisConvolutionDeep Learning In RadiologyDeep Learning-based Lesion ClassificationMalignant DiagnosisMedical Image FusionVision Transformers
Deep convolutional neural networks (CNNs) have been widely used in various medical imaging tasks. However, due to the intrinsic locality of convolution operations, CNNs generally cannot model long-range dependencies well, which are important for accurately identifying or mapping corresponding breast lesion features computed from unregistered multiple mammograms. This motivated us to leverage the architecture of Multi-view Vision Transformers to capture long-range relationships of multiple mammograms from the same patient in one examination. For this purpose, we employed local transformer blocks to separately learn patch relationships within four mammograms acquired from two-view (CC/MLO) of two-side (right/left) breasts. The outputs from different views and sides were concatenated and fed into global transformer blocks, to jointly learn patch relationships between four images representing two different views of the left and right breasts. To evaluate the proposed model, we retrospectively assembled a dataset involving 949 sets of mammograms, which included 470 malignant cases and 479 normal or benign cases. We trained and evaluated the model using a five-fold cross-validation method. Without any arduous preprocessing steps (e.g., optimal window cropping, chest wall or pectoral muscle removal, two-view image registration, etc.), our four-image (two-view-two-side) transformer-based model achieves case classification performance with an area under ROC curve (AUC = 0.818 ± 0.039), which significantly outperforms AUC = 0.784 ± 0.016 achieved by the state-of-the-art multi-view CNNs (p = 0.009). It also outperforms two one-view-two-side models that achieve AUC of 0.724 ± 0.013 (CC view) and 0.769 ± 0.036 (MLO view), respectively. The study demonstrates the potential of using transformers to develop high-performing computer-aided diagnosis schemes that combine four mammograms.
22
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Rebecca L. Siegel, Kimberly D. Miller, Hannah E. Fuchs et al. · CA A Cancer Journal for Clinicians · 2022 · 18.2K citations · Full text
A Deep Learning Mammography-based Model for Improved Breast Cancer Risk Prediction
Adam Yala, Constance D. Lehman, Tal Schuster et al. · Radiology · 2019 · 735 citations
Deep Neural Networks Improve Radiologists’ Performance in Breast Cancer Screening
Nan Wu, Jason Phang, Jungkyu Park et al. · IEEE Transactions on Medical Imaging · 2019 · 673 citations · Full text