Frontiers in Neuroscience · 2019 · 59 citations · 23 references
ComputingComputer ScienceComputer VisionMachine LearningNeural EngineeringDeep LearningHardware AccelerationNeural NetworksSpiking Neural NetworksAccuracyEvent-driven ComputationHardware Overhead AnalysisNeuromorphic DevicesNeuromorphic HardwareRecognition ProblemsSpiking Network ArchitecturesSpiking Neural Network Models
Spiking Neural Networks have gained traction as a low‑power, event‑driven neuromorphic paradigm, yet their use in machine learning has largely been confined to shallow models for simple tasks. This work introduces a new algorithmic method for constructing deep SNNs and evaluates it on challenging visual recognition benchmarks such as CIFAR‑10 and ImageNet. The method is applied to VGG and Residual network architectures, and analysis of the resulting sparse, event‑driven activity demonstrates reduced hardware overhead. The resulting deep SNNs achieve markedly higher accuracy than the current state‑of‑the‑art approaches.
Over the past few years, Spiking Neural Networks (SNNs) have become popular as a possible pathway to enable low-power event-driven neuromorphic hardware. However, their application in machine learning have largely been limited to very shallow neural network architectures for simple problems. In this paper, we propose a novel algorithmic technique for generating an SNN with a deep architecture, and demonstrate its effectiveness on complex visual recognition problems such as CIFAR-10 and ImageNet. Our technique applies to both VGG and Residual network architectures, with significantly better accuracy than the state-of-the-art. Finally, we present analysis of the sparse event-driven computations to demonstrate reduced hardware overhead when operating in the spiking domain.
23
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Going deeper with convolutions
Christian Szegedy, Wei Liu, Yangqing Jia et al. · 2015 · 46.8K citations
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations