Translational Vision Science & Technology · 2022 · 14 citations · 15 references
ComputingComputer ScienceSurgeryComputer VisionMachine LearningOphthalmic SurgeryDeep LearningInstrument ClassificationInstrument IdentificationMedical Image AnalysisPattern RecognitionSurgical Instrument ClassificationBenchmark DatasetsConvolutional Neural NetworksInstrument DetectionInstrument Image ClassificationIntraoperative Instrument IdentificationSurgical Instrument DetectionSurgical Instrument Recognition
Purpose: To develop a method for accurate automated real-time identification of instruments in cataract surgery videos. Methods: Cataract surgery videos were collected at University of Michigan's Kellogg Eye Center between 2020 and 2021. Videos were annotated for the presence of instruments to aid in the development, validation, and testing of machine learning (ML) models for multiclass, multilabel instrument identification. Results: A new cataract surgery database, BigCat, was assembled, containing 190 videos with over 3.9 million annotated frames, the largest reported cataract surgery annotation database to date. Using a dense convolutional neural network (CNN) and a recursive averaging method, we were able to achieve a test F1 score of 0.9528 and test area under the receiver operator characteristic curve of 0.9985 for surgical instrument identification. These prove to be state-of-the-art results compared to previous works, while also only using a fraction of the model parameters of the previous architectures. Conclusions: Accurate automated surgical instrument identification is possible with lightweight CNNs and large datasets. Increasingly complex model architecture is not necessary to retain a well-performing model. Recurrent neural network architectures add additional complexity to a model and are unnecessary to attain state-of-the-art performance. Translational Relevance: Instrument identification in the operative field can be used for further applications such as evaluating surgical trainee skill level and developing early warning detection systems for use during surgery.
15
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke et al. · 2017 · 12.6K citations · Full text
A survey on Image Data Augmentation for Deep Learning
Connor Shorten, Taghi M. Khoshgoftaar · Journal Of Big Data · 2019 · 12.4K citations · Full text
Measures of the Amount of Ecologic Association Between Species
Lee R. Dice · Ecology · 1945 · 11.9K citations
Text Data Augmentation for Deep Learning
Connor Shorten, Taghi M. Khoshgoftaar, Borko Furht · Journal Of Big Data · 2021 · 1.7K citations · Full text