Findings of the Association for Computational Linguistics: ACL 2022 · 2022 · 23 citations · 30 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingGraph-based LearningInformation ExtractionMulti-task LearningNamed Entity RecognitionTransfer LearningWord EmbeddingsContextual Feature RepresentationContextual Knowledge RepresentationCross-domain Named Entity RecognitionDomain AdaptationDomain-specific Word EmbeddingsEntity TypesFew-shot LearningGraph Matching
Cross-domain NER is a practical yet challenging problem since the data scarcity in the realworld scenario. A common practice is first to learn a NER model in a rich-resource general domain and then adapt the model to specific domains. Due to the mismatch problem between entity types across domains, the wide knowledge in the general domain can not effectively transfer to the target domain NER model. To this end, we model the label relationship as a probability distribution and construct label graphs in both source and target label spaces. To enhance the contextual representation with label structures, we fuse the label graph into the word embedding output by BERT. By representing label relationships as graphs, we formulate cross-domain NER as a graph matching problem. Furthermore, the proposed method has good applicability with pre-training methods and is potentially capable of other crossdomain prediction tasks. Empirical results on four datasets show that our method outperforms a series of transfer learning, multi-task learning, and few-shot learning methods.
30
Neural Architectures for Named Entity Recognition
Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian et al. · 2016 · 4.4K citations · Full text
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Thomas Wolf, Lysandre Debut, Victor Sanh et al. · arXiv (Cornell University) · 2019 · 3.1K citations · Full text