2010 · 242 citations · 16 references
ComputingComputer ScienceHigh-performance ComputingArtificial IntelligenceComputer VisionMachine LearningDeep LearningGraphics Processing Unit ComputingGraphics Processing UnitsNeural NetworksOptical Character RecognitionPattern RecognitionConvolutional Neural NetworksDeep Learning AccelerationDeep Learning AcceleratorsDeep Learning On GpusGpu AcceleratorsMachine Learning AccelerationMultilayer PerceptronScalability
In this paper we present the implementation of a framework for accelerating training and classification of arbitrary Convolutional Neural Networks (CNNs) on the GPU. CNNs are a derivative of standard Multilayer Perceptron (MLP) neural networks optimized for two-dimensional pattern recognition problems such as Optical Character Recognition (OCR) or face detection. We describe the basic parts of a CNN and demonstrate the performance and scalability improvement that can be achieved by shifting the computation-intensive tasks of a CNN to the GPU. Depending on the network topology training and classification on the GPU performs 2 to 24 times faster than on the CPU. Furthermore, the GPU version scales much better than the CPU implementation with respect to the network size.
16
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Neural networks for pattern recognition
Choice Reviews Online · 1994 · 18.7K citations
A unified architecture for natural language processing
Ronan Collobert, Jason Weston · 2008 · 5.2K citations