Photonics Research · 2022 · 24 citations · 24 references
ComputingBioengineeringComputer ScienceBiomedical ImagingComputer VisionDigital ImagingDeep LearningImagingMedical ImagingMultiphoton MicroscopyOptical ImagingSelf-supervised LearningHigh-resolution ImagingMicroscopyMicroscopy ImagingMicroscopy-based AnalysisTrainingTwo-photon Fluorescence ImagingTwo-photon Fluorescence MicroscopyTwo-photon Microscopy
Artificial neural networks have shown great proficiency in transforming low-resolution microscopic images into high-resolution images. However, training data remains a challenge, as large-scale open-source databases of microscopic images are rare, particularly 3D data. Moreover, the long training times and the need for expensive computational resources have become a burden to the research community. We introduced a deep-learning-based self-supervised volumetric imaging approach, which we termed “Self-Vision.” The self-supervised approach requires no training data, apart from the input image itself. The lightweight network takes just minutes to train and has demonstrated resolution-enhancing power on par with or better than that of a number of recent microscopy-based models. Moreover, the high throughput power of the network enables large image inference with less postprocessing, facilitating a large field-of-view ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" id="m1"> <mml:mrow> <mml:mn>2.45</mml:mn> <mml:mtext> </mml:mtext> <mml:mi>mm</mml:mi> <mml:mo>×</mml:mo> <mml:mn>2.45</mml:mn> <mml:mtext> </mml:mtext> <mml:mi>mm</mml:mi> </mml:mrow> </mml:math> ) using a home-built two-photon microscopy system. Self-Vision can recover images from fourfold undersampled inputs in the lateral and axial dimensions, dramatically reducing the acquisition time. Self-Vision facilitates the use of a deep neural network for 3D microscopy imaging, easing the demanding process of image acquisition and network training for current resolution-enhancing networks.
24
Two-Photon Laser Scanning Fluorescence Microscopy
Winfried Denk, James H. Strickler, Watt W. Webb · Science · 1990 · 9.4K citations
Content-aware image restoration: pushing the limits of fluorescence microscopy
Martin Weigert, Uwe Schmidt, Tobias Boothe et al. · Nature Methods · 2018 · 1.2K citations · Full text
Deep learning enables cross-modality super-resolution in fluorescence microscopy
Hongda Wang, Yair Rivenson, Yiyin Jin et al. · Nature Methods · 2018 · 802 citations · Full text
Yair Rivenson, Zoltán Göröcs, Harun Günaydın et al. · Optica · 2017 · 646 citations · Full text