Detection of intracranial aneurysms using deep learning-based CAD system: usefulness of the scores of CNN’s final layer for distinguishing between aneurysm and infundibular dilatation

Abstract

PURPOSE: We evaluated the diagnostic performance of a clinically available deep learning-based computer-assisted diagnosis software for detecting unruptured aneurysms (UANs) using magnetic resonance angiography and assessed the functionality of the convolutional neural network (CNN) final layer score for distinguishing between UAN and infundibular dilatation (ID). MATERIALS AND METHODS: EIRL brain aneurysm (EIRL_BA) was used in this study. The subjects were 117 UAN and/or ID cases including 100 UAN lesions (average sizes of 2.56 ± 1.45 mm) and 40 ID lesions (average sizes of 1.75 ± 0.41 mm) in any of internal carotid artery, middle cerebral artery, and anterior communicating artery, and 123 normal controls. The sensitivity, specificity, and accuracy of EIRL_BA were determined for UAN and ID or UAN only. Furthermore, the relationship between the lesion category and score was examined using a linear regression analysis model, and the receiver operating characteristic (ROC) analysis was used to assess whether the scores represent UAN-like characteristics. RESULTS: EIRL_BA showed a total of 203 candidates (an average of 1.73/case) in UAN and/or ID cases and 98 candidates (an average of 0.80/case) in normal controls. For diagnosing either UAN/ID, EIRL_BA showed an overall sensitivity of 80%, specificity of 84.2%, and accuracy of 83.7%, resulting in the positive likelihood ratio of 5.0. For diagnosing UAN only, the overall sensitivity of 89.0, specificity of 82.6%, and accuracy of 83.2% resulting in the positive likelihood ratio of 5.1. In a linear regression analysis, the scores significantly increased in the candidates' first and second ranks in UAN (p < 0.05) but not in ID. An ROC analysis using the score for diagnosing UAN showed an area under the curve of 0.836. CONCLUSION: EIRL_BA is applicable for detecting small UAN, and the CNN's final layer scores may be an effective index for discriminating UAN and ID and representing the likelihood of UAN.