2021 · 10 citations · 24 references
ComputingComputer ScienceNeuroscienceComputational NeuroscienceComputer VisionMachine LearningNeural NetworksNeural RepresentationNeuronal DynamicsObject RecognitionPattern RecognitionSpiking Neural NetworksEvent-based VisionGain ControlHebbian Learning RulesHomeostatic Control ModelingNeural Firing PatternsNeuromorphic HardwareNeuronal Firing PatternsVisual Scene Understanding
We propose a neuromimetic architecture able to perform pattern recognition. To achieve this, we extended the existing event-based algorithm from [1] which introduced novel spatio-temporal features: time surfaces. Built from asynchronous events acquired by a neuromorphic camera, these time surfaces allow to code the local dynamics of a visual scene and create an efficient hierarchical event-based pattern recognition architecture. Inspired by biological findings and the efficient coding hypothesis, our main contribution is to integrate homeostatic regulation into the Hebbian learning rule. Indeed, in order to be optimally informative, average neural activity within a layer should be equally balanced across neurons. We used that principle to regularize neurons within the same layer by setting a gain depending on their past activity and such that they emit spikes with balanced firing rates. The efficiency of this technique was first demonstrated through a robust improvement in spatio-temporal patterns which were learnt during the training phase. In order to compare with state-of-the-art methods, we replicated past results on the same dataset as [1] and extended results in this study to the widely used N-MNIST dataset [2]. We expect to extend this fully event-driven approach to more naturalistic tasks, notably for ultra-fast object categorization.
24
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Adam Paszke, Sam Gross, Francisco Massa et al. · arXiv (Cornell University) · 2019 · 16.2K citations · Full text
Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural Networks
Yujie Wu, Lei Deng, Guoqi Li et al. · Frontiers in Neuroscience · 2018 · 1.1K citations · Full text