2022 · 10 citations · 25 references
ComputingComputer ScienceComputational LinguisticsInformation RetrievalNatural Language ProcessingInformation ExtractionNamed Entity RecognitionSequence LabelingBenchmark Datasets
Named Entity Recognition (NER) is an important task in Natural Language Processing with applications in many domains. While the dominant paradigm of NER is sequence labelling, span-based approaches have become very popular in recent times but are less well understood. In this work, we study different aspects of span-based NER, namely the span representation, learning strategy, and decoding algorithms to avoid span overlap. We also propose an exact algorithm that efficiently finds the set of non-overlapping spans that maximizes a global score, given a list of candidate spans. We performed our study on three benchmark NER datasets from different domains. We make our code publicly available at https://github.com/urchade/span-structured-prediction.
25
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Neural Architectures for Named Entity Recognition
Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian et al. · 2016 · 4.4K citations · Full text
Bidirectional LSTM-CRF Models for Sequence Tagging
Zhiheng Huang, Kai Yu · arXiv (Cornell University) · 2015 · 3.3K citations · Full text
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Thomas Wolf, Lysandre Debut, Victor Sanh et al. · arXiv (Cornell University) · 2019 · 3.1K citations · Full text
SciBERT: A Pretrained Language Model for Scientific Text
Iz Beltagy, Kyle Lo, Arman Cohan · 2019 · 3K citations · Full text