arXiv (Cornell University) · 2020 · 40 citations · 24 references
ComputingLinguisticsComputational LinguisticsFeature EngineeringNatural Language ProcessingLanguage ModelingSpeech RecognitionAutomatic RecognitionAutomatic Speech TranslationConvolutionEnd-to-end Speech RecognitionTransformer Models
In this study, we present recent developments on ESPnet: End-to-End Speech Processing toolkit, which mainly involves a recently proposed architecture called Conformer, Convolution-augmented Transformer. This paper shows the results for a wide range of end-to-end speech processing applications, such as automatic speech recognition (ASR), speech translations (ST), speech separation (SS) and text-to-speech (TTS). Our experiments reveal various training tips and significant performance benefits obtained with the Conformer on different tasks. These results are competitive or even outperform the current state-of-art Transformer models. We are preparing to release all-in-one recipes using open source and publicly available corpora for all the above tasks with pre-trained models. Our aim for this work is to contribute to our research community by reducing the burden of preparing state-of-the-art research environments usually requiring high resources.
24
Connectionist temporal classification
Alex Graves, Santiago Fernández, Faustino Gomez et al. · 2006 · 5.4K citations
Kaldi Speech Recognition Toolkit
Daniel Povey · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 2024 · 4.9K citations · Full text
Computing, Linguistics, Acoustics +15
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Daniel Park, William Chan, Yu Zhang et al. · 2019 · 3.5K citations · Full text
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context
Zihang Dai, Zhilin Yang, Yiming Yang et al. · 2019 · 3.1K citations · Full text