Publication Server of the Institute for German Language (Institute for German Language) · 2010 · 18 citations · 1 references
Open access
ComputingComputer ScienceLinguisticsComputational LinguisticsCorpus LinguisticsNatural Language ProcessingAnnotationCorpus AnnotationLanguage ModelingLanguage ModelsNamed Entity RecognitionPart-of-speech TaggingCorpus CreationCorpus-based Part-of-speech TaggingCross-validationLexicon-based Part-of-speech TaggingStatistical Part-of-speech TaggingWord List Collection
This paper describes the application of probabilistic part of speech taggers to the Dzongkha language. A tag set containing 66 tags is designed, which is based on the Penn Treebank. A training corpus of 40,247 tokens is utilized to train the model. Using the lexicon extracted from the training corpus and lexicon from the available word list, we used two statistical taggers for comparison reasons. The best result achieved was 93.1% accuracy in a 10-fold cross validation on the training set. The winning tagger was thereafter applied to annotate a 570,247 token corpus.
1
Analysis and development of Urdu POS tagged corpus
Ahmed Muaz, Aasim Ali, Sarmad Hussain · 2009 · 29 citations · Full text