Journal of Field Robotics · 2021 · 83 citations · 32 references
ComputingComputer ScienceMarine SciencesArtificial IntelligenceComputer VisionMarine EcologyAnnotationCoral Reef ConservationDeep LearningImage AnnotationSemantic AnnotationSemantic Segmentation3D Semantic SegmentationAccuracyAutomated AnnotationAutomatic Semantic AnnotationInteractive AnnotationUser Study Evaluation
Abstract Semantic segmentation is a widespread image analysis task; in some applications, it requires such high accuracy that it still has to be done manually, taking a long time. Deep learning‐based approaches can significantly reduce such times, but current automated solutions may produce results below expert standards. We propose agLab, an interactive tool for the rapid labelling and analysis of orthoimages that speeds up semantic segmentation. TagLab follows a human‐centered artificial intelligence approach that, by integrating multiple degrees of automation, empowers human capabilities. We evaluated TagLab's efficiency in annotation time and accuracy through a user study based on a highly challenging task: the semantic segmentation of coral communities in marine ecology. In the assisted labelling of corals, TagLab increased the annotation speed by approximately 90% for nonexpert annotators while preserving the labelling accuracy. Furthermore, human–machine interaction has improved the accuracy of fully automatic predictions by about 7% on average and by 14% when the model generalizes poorly. Considering the experience done through the user study, TagLab has been improved, and preliminary investigations suggest a further significant reduction in annotation times.
32
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, Trevor Darrell · 2015 · 36.9K citations
Kaiming He, Georgia Gkioxari, Piotr Dollár et al. · 2017 · 28.8K citations
The Cityscapes Dataset for Semantic Urban Scene Understanding
Marius Cordts, Mohamed Omran, Sebastian Ramos et al. · 2016 · 11.9K citations
Carsten Rother, Vladimir Kolmogorov, Andrew Blake · ACM Transactions on Graphics · 2004 · 5.8K citations · Full text