The 2006 IEEE International Joint Conference on Neural Network Proceedings · 2006 · 13 citations · 13 references
ComputingComputer EngineeringComputer ScienceAnalog ElectronicsComputer VisionMachine LearningDeep LearningDigital Image ProcessingImage ProcessingLow-power Digital Circuit DesignNeural NetworksPattern RecognitionAccuracyComputation AccuracyConvolutional Neural NetworksConvolutional Neural Networks For Traffic SignsMultilayer PerceptronNeuromorphic HardwarePerceptronPower Consumption
Convolutional neural networks are known to be powerful image classifiers. In this work, a method is proposed for training convolutional networks for implementation on an existing mixed digital-analog VLSI hardware architecture. The binary threshold neurons provided by this architecture cannot be trained using gradient-based methods. The convolutional layers are trained with a clustering method, locally in each layer. The output layer is trained using the Perceptron learning rule. Competitive results are obtained on hand-written digits (MNIST) and traffic signs. The analog hardware enables high integration and low power consumption, but inherent error sources affect the computation accuracy. Networks trained as suggested are highly robust against random changes of synaptic weights occuring on the hardware substrate, and work well even with only three distinct weight values (-1, 0, +1), reducing computational complexity to mere counting.
13
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Hierarchical models of object recognition in cortex
Maximilian Riesenhuber, Tomaso Poggio · Nature Neuroscience · 1999 · 3.4K citations
Face recognition: a convolutional neural-network approach
Sandra Lawrence, C. Lee Giles, Ah Chung Tsoi et al. · IEEE Transactions on Neural Networks · 1997 · 3.1K citations