2017 · 27 citations · 16 references
ComputingBiomedical InformaticsComputer ScienceBiomedical Text MiningMachine LearningNatural Language ProcessingClinical Natural Language ProcessingDeep LearningDisease Mention DetectionInformation ExtractionNamed Entity RecognitionCross-language Information TransferDisease Entity RecognitionDisease Name RecognitionElectronic Medical RecordsRecurrent Neural Networks
In this paper, a transfer bi-directional recurrent neural networks (RNN) is proposed for named entity recognition (NER) in Chinese electronic medical records (EMRs) that aims to extract medical knowledge such as phrases recording diseases and treatments automatically. We propose a two-step procedure where the first step is to train a shallow bi-directional RNN in the general domain, and the second step is to transfer knowledge from the general domain to train a deeper bi-directional RNN for recognizing medical concepts from Chinese EMRs. Specifically, this is achieved by initializing the shallow parts of the deeper network in the second step with parameter weights from the bi-directional RNN trained in the first step. Then the deeper networks are re-trained on the Chinese EMRs. Experimental results show that NER performances are improved by the transferred knowledge significantly.
16
A unified architecture for natural language processing
Ronan Collobert, Jason Weston · 2008 · 5.2K citations
A study of thresholding strategies for text categorization
Yiming Yang · 2001 · 358 citations
Hai Leong Chieu, Hwee Tou Ng · 2002 · 311 citations · Full text