2002 · 29 citations · 16 references
ComputingComputer ScienceLinguisticsComputational LinguisticsNatural Language ProcessingStochastic ProcessesAnnotationLanguage ModelingLanguage ModelsParsingPart-of-speech TaggingSpeech Recognition
Many of the methods developed for Western European languages and used widespread to produce annotated language resources cannot readily be applied to Central and Eastern European languages, due to the large number of novel phenomena exhibited in the syntax and morphology of these languages, which these methods have to handle but have not been designed to cope with. The process of morphological tagging when applied to Hungarian data to produce corpora annotated at least at the morphosyntactic level is most indicative of this problem: several of the algorithms (either rule-based or statistical) that have been used very successfully in other domains cannot readily be applied to a language exhibiting such a varied morphology and huge number of wordforms as Hungarian. The paper will describe a robust tagging scenario for Hungarian using a relatively simple stochastic system augmented with external morphological processing, which can overcome the two most conspcicuous problems: the complexity of morphosyntactic descriptions and most importantly the huge number of possible wordforms. 1.
16
Thorsten Brants · 2000 · 1.3K citations · Full text
Tagging English text with a probabilistic model
Bernard Mérialdo · 1994 · 478 citations
Computing, Computer Science, English +15
MBT: A Memory-Based Part of Speech Tagger-Generator
Walter Daelemans, Jakub Zavrel, Peter Berck et al. · ArXiv.org · 1996 · 261 citations · Full text