Institutional Knowledge (InK) - Institutional Knowledge at Singapore Management University (Singapore Management University) · 2005 · 16 citations · 14 references
Open access
ComputingComputer ScienceLinguisticsComputational LinguisticsDiscourse AnalysisNatural Language ProcessingConversation AnalysisInformal NetworksLanguage ModelingNamed Entity RecognitionInformal Language TransmissionInformal RecognitionInformal Social Networks
Informal language is actively used in network-mediated communication, e.g. chat room, BBS, email and text message. We refer the anomalous terms used in such context as network informal language (NIL) expressions. For example, “�(ou3) ” is used to replace “�(wo3) ” in Chinese ICQ. Without unconventional resource, knowledge and techniques, the existing natural language processing approaches exhibit less effectiveness in dealing with NIL text. We propose to study NIL expressions with a NIL corpus and investigate techniques in processing NIL expressions. Two methods for Chinese NIL expression
14
Chunking with support vector machines
Taku Kudo, Yūji Matsumoto · 2001 · 533 citations
Computing, Computer Science, English +14
HHMM-based Chinese lexical analyzer ICTCLAS
Huaping Zhang, Hongkui Yu, Deyi Xiong et al. · 2003 · 454 citations · Full text
Normalization of non-standard words
Richard Sproat, Alan W. Black, Stanley Chen et al. · Computer Speech & Language · 2001 · 344 citations