IEEE Journal of Biomedical and Health Informatics · 2021 · 49 citations · 47 references
Artificial IntelligenceGeometric LearningConvolutional Neural NetworkEngineeringMachine LearningIntelligent DiagnosticsAutoencodersDiagnosisKnee Mri ExamAutomated Acl DiagnosisAnterior Cruciate LigamentImage AnalysisData SciencePattern RecognitionVideo TransformerRadiologyMachine VisionLightweight 3DFeature LearningComputer ScienceMedical Image ComputingDeep LearningComputer Vision
We propose an interpretable and lightweight 3D deep neural network model that diagnoses anterior cruciate ligament (ACL) tears from a knee MRI exam. Previous works focused primarily on achieving better diagnostic accuracy but paid less attention to practical aspects such as explainability and model size. They mainly relied on ImageNet pre-trained 2D deep neural network backbones, such as AlexNet or ResNet, which are computationally expensive. Some of them tried to interpret the models using post-inference visualization tools, such as CAM or Grad-CAM, which lack in generating accurate heatmaps. Our work addresses the two limitations by understanding the characteristics of ACL tear diagnosis. We argue that the semantic features required for classifying ACL tears are locally confined and highly homogeneous. We harness the unique characteristics of the task by incorporating: 1) attention modules and Gaussian positional encoding to reinforce the seeking of local features; 2) squeeze modules and fewer convolutional filters to reflect the homogeneity of the features. As a result, our model is interpretable: our attention modules can precisely highlight the ACL region without any location information given to them. Our model is extremely lightweight: consisting of only 43 K trainable parameters and 7.1 G of Floating-point operations per second (FLOPs), that is 225 times smaller and 91 times lesser than the previous state-of-the-art, respectively. Our model is accurate: our model outperforms the previous state-of-the-art with the average ROC-AUC of 0.983 and 0.980 on the Chiba and Stanford knee datasets, respectively.
47
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 214.9K citations · Full text
Image Classification, Deep Neural Networks, Machine Vision +14
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 73.5K citations · Full text
Going deeper with convolutions
Christian Szegedy, Wei Liu, Yangqing Jia et al. · 2015 · 46.2K citations
Image Classification, Deep Neural Networks, Image Analysis +15