Light Science & Applications · 2022 · 91 citations · 45 references
ComputingComputer ScienceComputer VisionMachine LearningMachine VisionDeep LearningDigital Image ProcessingFace RecognitionImage ProcessingNeural NetworksPattern RecognitionEncryptionMachine Vision SystemsNeural Network-based RecognitionOptical EncryptionPower ConsumptionPower Consumption OptimizationPrivacy-preserving Face RecognitionPrivacy-preserving Machine Learning
Machine vision faces bottlenecks in computing power consumption and large amounts of data. Although opto-electronic hybrid neural networks can provide assistance, they usually have complex structures and are highly dependent on a coherent light source; therefore, they are not suitable for natural lighting environment applications. In this paper, we propose a novel lensless opto-electronic neural network architecture for machine vision applications. The architecture optimizes a passive optical mask by means of a task-oriented neural network design, performs the optical convolution calculation operation using the lensless architecture, and reduces the device size and amount of calculation required. We demonstrate the performance of handwritten digit classification tasks with a multiple-kernel mask in which accuracies of as much as 97.21% were achieved. Furthermore, we optimize a large-kernel mask to perform optical encryption for privacy-protecting face recognition, thereby obtaining the same recognition accuracy performance as no-encryption methods. Compared with the random MLS pattern, the recognition accuracy is improved by more than 6%.
45
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Deep learning with coherent nanophotonic circuits
Yichen Shen, Nicholas C. Harris, Scott A. Skirlo et al. · Nature Photonics · 2017 · 3.1K citations · Full text
All-optical machine learning using diffractive deep neural networks
Yair Rivenson, Nezih Tolga Yardimci, Muhammed Veli et al. · Science · 2018 · 2.4K citations · Full text