2015 · 48 citations · 16 references
Language StudiesLinguisticsApplied LinguisticsComputational LinguisticsNatural Language ProcessingLanguage ModelingLanguage ModelsN-gram AnalysisN-gram SmoothingN-gram StatisticsSmoothingSpelling Error AnalysisSpelling Error DetectionWord N-gramsWord Segmentation
This paper presents our system in the Chinese spelling check (CSC) task of SIGHAN-8 Bake-Off. Given a sentence, our systems are designed to detect and correct the spelling error. As we know, CSC is still a hot topic today and it is an open problem yet. N-gram language modeling (LM) is widely used in CSC, since its simplicity and power. We present a model based on joint bi-gram and trigram LM and Chinese word segmentation. Besides, we apply dynamic programming to increase efficiency and employ smoothing technique to address the sparseness of the n-gram in training data. The evaluation results show the utility of our CSC system.
16
A rule based Chinese spelling and grammar detection system utility
Ying Jiang, Tong Wang, Tao Lin et al. · 2012 · 44 citations