2022 · 19 citations · 24 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingPhoneticsLanguage ModelingSpeech RecognitionAblation StudiesAuxiliary Task LearningChinese CharactersEmpirical EvaluationPhonetic Similarity AnalysisPronunciation ModelingSpelling Error DetectionSpelling Errors
Chinese spelling check (CSC) is a fundamental NLP task that detects and corrects spelling errors in Chinese texts. As most of these spelling errors are caused by phonetic similarity, effectively modeling the pronunciation of Chinese characters is a key factor for CSC. In this paper, we consider introducing an auxiliary task of Chinese pronunciation prediction (CPP) to improve CSC, and, for the first time, systematically discuss the adaptivity and granularity of this auxiliary task. We propose SCOPE which builds upon a shared encoder two parallel decoders, one for the primary CSC task and the other for a fine-grained auxiliary CPP task, with a novel adaptive weighting scheme to balance the two tasks. In addition, we design a delicate iterative correction strategy for further improvements during inference. Empirical evaluation shows that SCOPE achieves new state-of-the-art on three CSC benchmarks, demonstrating the effectiveness and superiority of the auxiliary CPP task. Comprehensive ablation studies further verify the positive effects of adaptivity and granularity of the task.
24
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Binary codes capable of correcting deletions, insertions and reversals
V.I. Levenshtein · Soviet physics. Doklady · 1965 · 10.4K citations
Spelling Error Correction with Soft-Masked BERT
Shaohua Zhang, Haoran Huang, Jicong Liu et al. · 2020 · 204 citations · Full text
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information
Zijun Sun, Xiaoya Li, Xiaofei Sun et al. · 2021 · 192 citations · Full text
A Hybrid Approach to Automatic Corpus Generation for Chinese Spelling Check
Dingmin Wang, Yan Song, Jing Li et al. · 2018 · 140 citations · Full text
Language Studies, Computer Science, Computational Linguistics +12