A comparative study of stemming algorithms for use with the Uzbek language

Abstract

Stemming is one of the pipeline feature of Information Retrieval and commonly used in natural language processing and text mining. The main purpose of a stemming process is to reduce the inflectional or derivational word into its root form. The difficulties on developing stemming algorithm is to identify and remove affixes since each language in the world has unique characteristics and grammatical rules. This paper compares related study on existing stemmers to be used in Uzbek language. We discuss the type of stemming algorithms, an overview of available popular English stemmers and comparison between discussed stemmers as well as their evaluation and analysis of available stemmers on Uzbek language experiment. Based on the comparative study and experiment, we proposal our model of the Uzbek stemmer that enhances some of the features in Lovins stemmer to suit the requirements for the Uzbek language.