Science Advances · 2022 · 78 citations · 45 references
ComputingAutonomous SystemsComputer ScienceComputer VisionMachine LearningMachine VisionDeep LearningDigital Image ProcessingHardware AccelerationImage ProcessingObject RecognitionPattern RecognitionConvolutionDeep Learning AcceleratorsImage Processing AcceleratorsMachine Vision SystemsObject ClassificationOptical MultiplexingPolarizationReal-time Decision Making
Rapid advances in deep learning have led to paradigm shifts in a number of fields, from medical image analysis to autonomous systems. These advances, however, have resulted in digital neural networks with large computational requirements, resulting in high energy consumption and limitations in real-time decision-making when computation resources are limited. Here, we demonstrate a meta-optic-based neural network accelerator that can off-load computationally expensive convolution operations into high-speed and low-power optics. In this architecture, metasurfaces enable both spatial multiplexing and additional information channels, such as polarization, in object classification. End-to-end design is used to co-optimize the optical and digital systems, resulting in a robust classifier that achieves 93.1% accurate classification of handwriting digits and 93.8% accuracy in classifying both the digit and its polarization state. This approach could enable compact, high-speed, and low-power image and information processing systems for a wide range of applications in machine vision and artificial intelligence.
45
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
All-optical machine learning using diffractive deep neural networks
Yair Rivenson, Nezih Tolga Yardimci, Muhammed Veli et al. · Science · 2018 · 2.4K citations · Full text
Photonics for artificial intelligence and neuromorphic computing
Nature Photonics · 2021 · 1.6K citations · Full text