2009 · 729 citations · 29 references
ComputingComputer ScienceArtificial IntelligenceKnowledge RepresentationMachine LearningDeep LearningNeural NetworksRepresentation LearningScalable Machine LearningUnsupervised LearningBelief NetworksDeep Belief NetworksSparse CodingUnsupervised Neural Learning
The promise of unsupervised learning methods lies in their potential to use vast amounts of unlabeled data to learn complex, highly nonlinear models with millions of free parameters. We consider two well-known unsupervised learning models, deep belief networks (DBNs) and sparse coding, that have recently been applied to a flurry of machine learning applications (Hinton & Salakhutdinov, 2006; Raina et al., 2007). Unfortunately, current learning algorithms for both models are too slow for large-scale applications, forcing researchers to focus on smaller-scale models, or to use fewer training examples.
29
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
A Fast Learning Algorithm for Deep Belief Nets
Geoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh · Neural Computation · 2006 · 16.4K citations
Bradley Efron, Trevor Hastie, Iain M. Johnstone et al. · The Annals of Statistics · 2004 · 9.5K citations · Full text