2012 · 18 citations · 16 references
ComputingLinguisticsAcousticsMachine LearningPhoneticsAcoustic PhoneticsDeep LearningNeural NetworksPattern RecognitionSpeech AcousticsSpeech RecognitionArticulatory Feature SystemsBelief NetworksDeep Belief NetworksDeep Neural Network Acoustic ModelsPhoneme RecognitionPhoneme-to-acoustics MappingUnsupervised Feature Learning
In this paper we experiment with methods based on Deep Belief Networks (DBNs) to recover measured articulatory data from speech acoustics. Our acoustic-to-articulatory mapping (AAM) processes go through multi-layered and hierarchical (i.e., deep) representations of the acoustic and the articulatory domains obtained through unsupervised learning of DBNs. The unsupervised learning of DBNs can serve two purposes: (i) pre-training of the Multi-layer Perceptrons that perform AAM; (ii) transformation of the articulatory domain that is recovered from acoustics through AAM. The recovered articulatory features are combined with MFCCs to compute phone posteriors for phone recognition. Tested on the MOCHA-TIMIT corpus, the recovered articulatory features, when combined with MFCCs, lead to up to a remarkable 16.6% relative phone error reduction w.r.t. a phone recognizer that only uses MFCCs.
16
A Fast Learning Algorithm for Deep Belief Nets
Geoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh · Neural Computation · 2006 · 16.4K citations
Jiquan Ngiam, Aditya Khosla, Mingyu Kim et al. · 2011 · 2.3K citations
Why Does Unsupervised Pre-training Help Deep Learning?
Dumitru Erhan, Aaron Courville, Yoshua Bengio et al. · 2010 · 2.1K citations