2020 · 10 citations · 21 references
ComputingComputer ScienceLinguisticsComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningLanguage ModelingLanguage ModelsNeural NetworksPattern RecognitionSpeech RecognitionConvolutional Neural NetworksEnd-to-end Speech RecognitionExperimental StudiesLanguage Model IntegrationLong-context ModelingRecurrent Neural Network Language ModelsRecurrent Neural NetworksRegularization
In this paper investigates the approach to realization of recognition of Uzbek words on the basis of end-to-end models is considered. Also presented are some theoretical data on the architecture of neural networks used in the integrated model, and the results of preliminary experimental studies conducted on their basis. Deep recurrent neural networks, which combine the multiple levels of representation that have proved so effective in deep networks with the flexible use of long-range context that empowers RNNs. When trained end-to-end with suitable regularization, we find that deep BRNNs achieve a test set error of CER=49.1% on our dataset.
21
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Speech recognition with deep recurrent neural networks
Alex Graves, Abdelrahman Mohamed, Geoffrey E. Hinton · 2013 · 8.8K citations
Connectionist temporal classification
Alex Graves, Santiago Fernández, Faustino Gomez et al. · 2006 · 5.4K citations