arXiv (Cornell University) · 2020 · 10 citations · 15 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningLanguage ModelingNamed Entity RecognitionPattern RecognitionWord RecognitionCharacter-level RepresentationChinese Character RecognitionChinese CharactersDeep Feature FusionGlyph-based NetworksNeural Text RepresentationRepresentation Fusion
Chinese NER is a challenging task. As pictographs, Chinese characters contain latent glyph information, which is often overlooked. In this paper, we propose the FGN, Fusion Glyph Network for Chinese NER. Except for adding glyph information, this method may also add extra interactive information with the fusion mechanism. The major innovations of FGN include: (1) a novel CNN structure called CGS-CNN is proposed to capture both glyph information and interactive information between glyphs from neighboring characters. (2) we provide a method with sliding window and Slice-Attention to fuse the BERT representation and glyph representation for a character, which may capture potential interactive knowledge between context and glyph. Experiments are conducted on four NER datasets, showing that FGN with LSTM-CRF as tagger achieves new state-of-the-arts performance for Chinese NER. Further, more experiments are conducted to investigate the influences of various components and settings in FGN.
15
Natural Language Processing (almost) from Scratch
Ronan Collobert, Jason Weston, Léon Bottou et al. · arXiv (Cornell University) · 2011 · 5.2K citations · Full text
Bidirectional LSTM-CRF Models for Sequence Tagging
Zhiheng Huang, Kai Yu · arXiv (Cornell University) · 2015 · 3.3K citations · Full text
Chinese NER Using Lattice LSTM