ETRI Journal · 2014 · 10 citations · 20 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingLanguage ModelingPart-of-speech TaggingBackpropagationChunkingText Chunking
Most natural language processing tasks depend on the outputs of some other tasks. Thus, they involve other tasks as subtasks. The main problem of this type of pipelined model is that the optimality of the subtasks that are trained with their own data is not guaranteed in the final target task, since the subtasks are not optimized with respect to the target task. As a solution to this problem, this paper proposes a consolidation of subtasks for a target task (CST2). In CST2, all parameters of a target task and its subtasks are optimized to fulfill the objective of the target task. CST2 finds such optimized parameters through a backpropagation algorithm. In experiments in which text chunking is a target task and part-of-speech tagging is its subtask, CST2 outperforms a traditional pipelined text chunker. The experimental results prove the effectiveness of optimizing subtasks with respect to the target task.
20
Rich Caruana · Machine Learning · 1997 · 6.3K citations · Full text
A unified architecture for natural language processing
Ronan Collobert, Jason Weston · 2008 · 5.2K citations
Feature-rich part-of-speech tagging with a cyclic dependency network
Kristina Toutanova, Dan Klein, Christopher D. Manning et al. · 2003 · 2.9K citations · Full text
Chunking with support vector machines
Taku Kudo, Yūji Matsumoto · 2001 · 533 citations
Computing, Computer Science, English +14