2006 · 1.6K citations · 23 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingLanguage ModelingLanguage ModelsParsingPart-of-speech TaggingDomain AdaptationParser AdaptationTarget Domain Adaptation
Discriminative learning methods are widely used in NLP but perform best when training and test data come from the same distribution, a challenge when labeled data is scarce in new domains. The goal is to adapt models from a resource‑rich source domain to a resource‑poor target domain. Structural correspondence learning automatically induces correspondences among features from different domains. Applying this technique to part‑of‑speech tagging yields performance gains across varying amounts of source and target data and improves target‑domain parsing accuracy with the enhanced tagger.
Discriminative learning methods are widely used in natural language processing. These methods work best when their training and test data are drawn from the same distribution. For many NLP tasks, however, we are confronted with new domains in which labeled data is scarce or non-existent. In such cases, we seek to adapt existing models from a resource-rich source domain to a resource-poor target domain. We introduce structural correspondence learning to automatically induce correspondences among features from different domains. We test our technique on part of speech tagging and show performance gains for varying amounts of source and target training data, as well as improvements in target domain parsing accuracy using our improved tagger.
23
Combining labeled and unlabeled data with co-training
Avrim Blum, Tom M. Mitchell · 1998 · 5.6K citations · Full text
Class-based n -gram models of natural language
Peter F. Brown, P.V. deSouza, Robert L. Mercer et al. · 1992 · 2.9K citations
Language Studies, Computer Science, Computational Linguistics +15
Feature-rich part-of-speech tagging with a cyclic dependency network
Kristina Toutanova, Dan Klein, Christopher D. Manning et al. · 2003 · 2.9K citations · Full text