Journal of the American Society for Information Science and Technology · 2004 · 54 citations · 15 references
Language StudiesArabicComputer ScienceCorpus LinguisticsInformation RetrievalNatural Language ProcessingCorpus RetrievalN-gram AnalysisPrecisionRetrievalText Retrieval
N‑grams have been widely studied for various text processing and retrieval tasks. The study evaluates the performance of digram and trigram term conflation techniques for Arabic free‑text retrieval. The authors assess digram and trigram conflation by applying them to Arabic text and measuring retrieval performance. Results show digram outperforms trigram in conflation precision and recall, yet overall N‑gram conflation remains inefficient due to Arabic infix structure limiting correct matching.
Abstract N‐grams have been widely investigated for a number of text processing and retrieval applications. This article examines the performance of the digram and trigram term conflation techniques in the context of Arabic free text retrieval. It reports the results of using the N‐gram approach for a corpus of thousands of distinct textual words drawn from a number of sources representing various disciplines. The results indicate that the digram method offers a better performance than trigram with respect to conflation precision and conflation recall ratios. In either case, the N‐gram approach does not appear to provide an efficient conflation approach due to the peculiarities imposed by the Arabic infix structure that reduces the rate of correct N‐gram matching.
15