arXiv (Cornell University) · 2014 · 984 citations · 4 references
ComputingComputer ScienceHigh-performance ComputingMachine LearningParallel AlgorithmsParallel ComputingData ParallelismDeep LearningGraphics Processing Unit ComputingGraphics Processing UnitsParallel ArchitecturesParallel Computing SystemsConvolutional Neural NetworksDeep Learning On GpusGpu Parallel AlgorithmsMulti-gpu ArchitecturesMulti-gpu ComputingMulti-gpu SystemsParallel Deep LearningParallel Machine Learning
I present a new way to parallelize the training of convolutional neural networks across multiple GPUs. The method scales significantly better than all alternatives when applied to modern convolutional neural networks.
4
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Large Scale Distributed Deep Networks
Jay B. Dean, Greg S. Corrado, Rajat Monga et al. · 2012 · 2.9K citations
Deep learning with COTS HPC systems
Adam Coates, Brody Huval, Tao Wang et al. · 2013 · 608 citations