2012 · 341 citations · 9 references
ComputingComputer ScienceAcousticsComputational AcousticsMachine LearningDeep LearningNeural NetworksNoiseNoise ReductionSpeech AcousticsSpeech RecognitionAdditive NoiseAutomatic RecognitionDeep Neural Network Acoustic ModelsNoise RobustnessRecurrent Neural NetworksRobust Speech RecognitionSpeech Enhancement For Recognition
Recent work on deep neural networks as acoustic models for automatic speech recognition (ASR) have demonstrated substantial performance improvements. We introduce a model which uses a deep recurrent auto encoder neural network to denoise input features for robust ASR. The model is trained on stereo (noisy and clean) audio features to predict clean features given noisy input. The model makes no assumptions about how noise affects the signal, nor the existence of distinct noise environments. Instead, the model can learn to model any type of distortion or additive noise given sufficient training data. We demonstrate the model is competitive with existing feature denoising approaches on the Aurora2 task, and outperforms a tandem approach where deep networks are used to predict phoneme posteriors directly. Index Terms: neural networks, robust ASR, deep learning 1.
9
Extracting and composing robust features with denoising autoencoders
Pascal Vincent, Hugo Larochelle, Yoshua Bengio et al. · 2008 · 7.3K citations
On optimization methods for deep learning
Jiquan Ngiam, Adam Coates, Ahbik Lahiri et al. · International Conference on Machine Learning · 2011 · 888 citations
Large vocabulary continuous speech recognition with context-dependent DBN-HMMS
George E. Dahl, Dong Yu, Li Deng et al. · 2011 · 182 citations
Revisiting Recurrent Neural Networks for robust ASR
Oriol Vinyals, Suman Ravuri, Daniel Povey · 2012 · 142 citations