China Communications · 2017 · 63 citations · 19 references
ComputingComputer ScienceComputational AcousticsMachine LearningNatural Language ProcessingAcoustic ModelingDeep LearningHidden Markov ModelsLong-term MemoryShort-term MemorySpeech RecognitionConnectionist Temporal ClassificationDeep Neural Network Acoustic ModelsGaussian Mixture ModelsHidden Markov Model TrainingLong Short-term Memory NetworksRecurrent Neural NetworksTemporal ClassificationWord Error Rate
A Long Short-Term Memory (LSTM) Recurrent Neural Network (RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model (GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model (HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate (WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.
19
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Klaus Greff, Rupesh K. Srivastava, Jan Koutník et al. · IEEE Transactions on Neural Networks and Learning Systems · 2016 · 6.8K citations · Full text
Connectionist temporal classification
Alex Graves, Santiago Fernández, Faustino Gomez et al. · 2006 · 5.4K citations
Recurrent neural network based language model
Tomáš Mikolov, Martin Karafiát, Lukáš Burget et al. · 2010 · 5.4K citations