The Journal of Cell Biology · 2020 · 39 citations · 24 references
ComputingCell BiologyComputer ScienceBiophotonicsComputer VisionMachine VisionAugmented RealityCellular ImagingFluorescence ImagingFluorescence MicroscopyObject DetectionObject Recognition3D Object DetectionAutomated Object DetectionClassification AccuracyClassification Accuracy MetricsFluorescence Microscopy AcquisitionMicroscopyObject LocalizationReal-time Processing
Object detection networks are high-performance algorithms famously applied to the task of identifying and localizing objects in photography images. We demonstrate their application for the classification and localization of cells in fluorescence microscopy by benchmarking four leading object detection algorithms across multiple challenging 2D microscopy datasets. Furthermore we develop and demonstrate an algorithm that can localize and image cells in 3D, in close to real time, at the microscope using widely available and inexpensive hardware. Furthermore, we exploit the fast processing of these networks and develop a simple and effective augmented reality (AR) system for fluorescence microscopy systems using a display screen and back-projection onto the eyepiece. We show that it is possible to achieve very high classification accuracy using datasets with as few as 26 images present. Using our approach, it is possible for relatively nonskilled users to automate detection of cell classes with a variety of appearances and enable new avenues for automation of fluorescence microscopy acquisition pipelines.
24
Fiji: an open-source platform for biological-image analysis
Johannes Schindelin, Ignacio Arganda‐Carreras, Erwin Frise et al. · Nature Methods · 2012 · 70.9K citations
The Pascal Visual Object Classes Challenge: A Retrospective
Mark Everingham, S. M. Ali Eslami, Luc Van Gool et al. · International Journal of Computer Vision · 2014 · 7.3K citations · Full text
YOLOv3: An Incremental Improvement
Joseph Redmon, Ali Farhadi · arXiv (Cornell University) · 2018 · 5.9K citations · Full text