IEEE Access · 2023 · 10 citations · 30 references
ComputingArabicComputer ScienceMachine LearningNatural Language ProcessingPhoneticsDeep LearningLanguage ModelingLanguage ModelsPattern RecognitionSpeech RecognitionAutomatic DiacritizationDiacritics RepresentationNeural Language ModelsRecurrent Neural Network Language ModelsSpeech Pattern Recognition
Arabic is the language of more than 422 million of the world’s population. Although classic Arabic is the Quran language that 1.9 billion Muslims are required to recite, limited Arabic speech recognition exists. In classic Arabic, diacritics affect the pronunciation of a word, a change in a diacritic can change the meaning of a word. However, most of the Arabic-based speech recognition models discarded the diacritics. This work aims to recognize the classic Arabic speech while considering diacritics by converting audio signals to diacritized text using Deep Neural Network (DNN)-based models. The DNN-based model recognizes speech using DNN which outperformed the traditional speech recognition systems’ phonetics dependency. Three models were developed to recognize Arabic speech: (i) Time Delay Neural Network-Connectionist Temporal Classification (CTC), (ii) Recurrent Neural Network (RNN)-CTC, and (iii) transformer. A 100hours dataset of the Quran recordings has been used. Based on the results, the RNN-CTC model obtained state-of-the-art results with the lowest word error rate of 19.43% and a 3.51% character error rate. RNN-CTC model recognized character-by-character which is more reliable compared to transformers’ whole-sentence recognition behaviour. The model performed well with clear unstressed recordings of short sentences. Moreover, the RNN-CTC model effectively recognized out-of-the-dataset sounds. The findings recommend continuing the efforts in enhancing the diacritics-based Arabic speech recognition models using clear and unstressed recordings to obtain better performance. Moreover, pretraining large speech models could obtain accurate recognition. The outcomes can be used to enhance the existing classic Arabic speech recognition solutions by supporting diacritics recognition.
30
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Binary codes capable of correcting deletions, insertions and reversals
V.I. Levenshtein · Soviet physics. Doklady · 1965 · 10.4K citations
Decoupled Weight Decay Regularization
Ilya Loshchilov, Frank Hutter · arXiv (Cornell University) · 2017 · 9.1K citations · Full text
An Overview of Overfitting and its Solutions
Ying Xue · Journal of Physics Conference Series · 2019 · 2.2K citations · Full text