Computer Methods in Biomechanics and Biomedical Engineering Imaging & Visualization · 2022 · 12 citations · 13 references
ComputingComputer ScienceSurgeryComputer VisionMachine LearningMachine VisionAnnotationObject DetectionObject RecognitionSemi-supervised LearningSupervised LearningClassification LossForeground-background SeparationKnowledge DistillationLabeled Data ScarcityMargin-based LossSemi-supervised ModelsSurgical Instrument DetectionTeacher-student Learning
Surgical tool detection in minimally invasive surgery is an essential part of computer-assisted interventions. Current approaches are mostly based on supervised methods requiring large annotated datasets. However, labelled datasets are often scarce. Semi-supervised learning (SSL) has recently emerged as a viable alternative showing promise in producing models retaining competitive performance to supervised methods. Therefore, this paper introduces an SSL framework in the surgical tool detection paradigm, which aims to mitigate training data scarcity and data imbalance problems through a knowledge distillation approach. In the proposed work, we train a model with labelled data which initialises the Teacher-Student joint learning, where the Student is trained on Teacher-generated pseudo-labels from unlabelled data. We also propose a multi-class distance with a margin-based classification loss function in the region-of-interest head of the detector to segregate the foreground-background region effectively. Our results on m2cai16-tool-locations dataset indicates the superiority of our approach on different supervised data settings (1%, 2%, 5% and 10% of annotated data) where our model achieves overall improvements of 8%, 12%, and 27% in mean average precision on 1% labelled data over the state-of-the-art SSL methods and the supervised baseline, respectively. The code is available at https://github.com/Mansoor-at/Semi-supervised-surgical-tool-detection.
13
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
A survey on semi-supervised learning
Jesper E. van Engelen, Holger H. Hoos · Machine Learning · 2019 · 2.6K citations · Full text