2016 · 39 citations · 26 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningLanguage ModelingPattern RecognitionSpeech RecognitionAutomated Speaking AssessmentAutomated Speech ScoringBottleneck DetectionCorpus BuildingRobustnessScoring ModelsSpeech Recognition EvaluationSpontaneous Speech Assessment
We investigate two deep learning architectures reported to have superior performance in ASR over the conventional GMM system, with respect to automatic speech scoring. We use an approximately 800-hour large-vocabulary non-native spontaneous English corpus to build three ASR systems. One system is in GMM, and two are in deep learning architectures - namely, DNN and Tandem with bottleneck features. The evaluation results show that the both deep learning systems significantly outperform the GMM ASR. These ASR systems are used as the front-end in building an automated speech scoring system. To examine the effectiveness of the deep learning ASR systems for automated scoring, another non-native spontaneous speech corpus is used to train and evaluate the scoring models. Using deep learning architectures, ASR accuracies drop significantly on the scoring corpus, whereas the performance of the scoring systems get closer to human raters, and consistently better than the GMM one. Compared to the DNN ASR, the Tandem performs slightly better on the scoring speech while it is a little less accurate on the ASR evaluation dataset. Furthermore, given the results of the improved scoring performance while using fewer scoring features, the Tandem system shows more robustness for scoring task than the DNN one.
26
Kaldi Speech Recognition Toolkit
Daniel Povey · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 2024 · 4.9K citations · Full text
Computing, Linguistics, Acoustics +15
Sequence-discriminative training of deep neural networks
Karel Veselý, Arnab Ghoshal, Lukáš Burget et al. · 2013 · 662 citations · Full text