Physics in Medicine and Biology · 2024 · 11 citations · 10 references
ComputingComputer ScienceGynecologyBiomedical ImagingDiagnostic ImagingMachine LearningComputer-aided DiagnosisDeep LearningEndometriosisMedical Image AnalysisMedical ImagingPattern RecognitionEndometriosis DetectionHuman-ai Collaboration In LearningLesion ClassificationMachine Learning In NeuroimagingMulti-modal Representation LearningMultimodal Imaging AnalysisMultimodal Recognition Fusion
Abstract Objective. Endometriosis, affecting about 10% of individuals assigned female at birth, is challenging to diagnose and manage. Diagnosis typically involves the identification of various signs of the disease using either laparoscopic surgery or the analysis of T1/T2 MRI images, with the latter being quicker and cheaper but less accurate. A key diagnostic sign of endometriosis is the obliteration of the pouch of Douglas (POD). However, even experienced clinicians struggle with accurately classifying POD obliteration from MRI images, which complicates the training of reliable AI models. Approach. In this paper, we introduce the H uman– AI Co llaborative M ulti-modal M ulti-rater Learning (HAICOMM) methodology to address the challenge above. HAICOMM is the first method that explores three important aspects of this problem: (1) multi-rater learning to extract a cleaner label from the multiple ‘noisy’ labels available per training sample; (2) multi-modal learning to leverage the presence of T1/T2 MRI images for training and testing; and (3) human–AI collaboration to build a system that leverages the predictions from clinicians and the AI model to provide more accurate classification than standalone clinicians and AI models. Main results. Presenting results on the multi-rater T1/T2 MRI endometriosis dataset collected for validating the methodology, the proposed HAICOMM model outperforms an ensemble of clinicians, noisy-label learning models, and multi-rater learning methods by a large margin. Significance. The HAICOMM methodology offers a novel solution to the long-standing problem of accurately diagnosing endometriosis from MRI images, specifically in relation to the key diagnostic sign of POD obliteration. By leveraging multi-rater, multi-modal, and human–AI collaborative learning, it has the potential to improve the accuracy of endometriosis diagnosis, which could have far-reaching implications for the better management of this challenging medical condition that affects a significant proportion of the female population.
10
ESHRE guideline: endometriosis
Christian M. Becker, Attila Bokor, Oskari Heikinheimo et al. · Human Reproduction Open · 2022 · 1.5K citations · Full text
Medicine, Gynecology, Oncology +13
A survey of human-in-the-loop for machine learning
Xingjiao Wu, Luwei Xiao, Yixuan Sun et al. · Future Generation Computer Systems · 2022 · 669 citations · Full text
Unpaired Multi-Modal Segmentation via Knowledge Distillation
Qi Dou, Quande Liu, Pheng‐Ann Heng et al. · IEEE Transactions on Medical Imaging · 2020 · 215 citations · Full text