Science Advances · 2024 · 42 citations · 62 references
EngineeringBiomedical EngineeringBiomedical ImagingComputer VisionReconfigurable ComputingDeep LearningImagingMedical ImagingOptical ImagingScattering In TissueUltrafast OpticsHigh-speed ImagingImage Reconstruction AlgorithmsLight Scattering In TissueMicroscopic ImagingOptical Neural NetworksScatteringScattering-based Optical ImagingSpeckle Phenomena
The optical memory effect in complex scattering media including turbid tissue and speckle layers has been a critical foundation for macroscopic and microscopic imaging methods. However, image reconstruction from strong scattering media without the optical memory effect has not been achieved. Here, we demonstrate image reconstruction through scattering layers where no optical memory effect exists, by developing a multistage convolutional optical neural network (ONN) integrated with multiple parallel kernels operating at the speed of light. Training this Fourier optics-based, parallel, one-step convolutional ONN with the strong scattering process for direct feature extraction, we achieve memory-less image reconstruction with a field of view enlarged by a factor up to 271. This device is dynamically reconfigurable for ultrafast multitask image reconstruction with a computational power of 1.57 peta-operations per second (POPS). Our achievement establishes an ultrafast and high energy-efficient optical machine learning platform for graphic processing.
62
A Stochastic Approximation Method
Herbert Robbins, Sutton Monro · The Annals of Mathematical Statistics · 1951 · 9.6K citations · Full text
All-optical machine learning using diffractive deep neural networks
Yair Rivenson, Nezih Tolga Yardimci, Muhammed Veli et al. · Science · 2018 · 2.4K citations · Full text