2009 · 44 citations · 12 references
ComputingArabicComputer ScienceComputational LinguisticsNatural Language ProcessingText AnalyticsLanguage ModelingN-gram AnalysisText PreprocessingArabic SpellingAutomatic DiacritizationCorpus CreationDiacritics RepresentationPost-processingSyntactic Ambiguity
Modern standard Arabic is usually written without diacritics. This makes it difficult for performing Arabic text processing. Diacritization helps clarify the meaning of words and disambiguate any vague spellings or pronunciations, as some Arabic words are spelled the same but differ in meaning. In this paper, we address the issue of adding diacritics to undiacritized Arabic text using a hybrid approach. The approach requires an Arabic lexicon and large corpus of fully diacritized text for training purposes in order to detect diacritics. Case-Ending is treated as a separate post processing task using syntactic information. The hybrid approach relies on lexicon retrieval, bigram, and SVM-statistical prioritized techniques. We present results of an evaluation of the proposed diacritization approach and discuss various modifications for improving the performance of this approach.
12
Marti A. Hearst, Susan Dumais, E. Osuna et al. · IEEE Intelligent Systems and their Applications · 1998 · 6.9K citations
Automatic tagging of Arabic text
Mona Diab, Kadri Hacıoğlu, Daniel Jurafsky · 2004 · 311 citations · Full text
Computing, Arabic, Computer Science +17
Fast methods for kernel-based text analysis
Taku Kudo, Yūji Matsumoto · 2003 · 207 citations · Full text