Tokenization for Morphological Analysis is a preprocessing methodology in computational linguistics that segments textual input into linguistically meaningful units—such as morphemes or subword units—specifically to facilitate the disambiguation and analysis of word structure in morphologically rich languages.
45
Publications
2.3K
Citations
88
Authors
49
Institutions
Publications per year
2017–2026
13
Parents
Publications
45
Tokenization as the initial phase in NLP
Jonathan J. Webster, Chunyu Kit · 1992 · 364 citations · Full text
Mohammed Attia · 2007 · 101 citations · Full text
1–5 of 45
Authors
88
- NH
3
h-index
- MS
2
h-index
- SJ
2
h-index
- JS
2
h-index
- DJ
2
h-index
1–5 of 88
Institutions
49
Columbia University
New York, United States
2 h-index
6 publications
966 citations
The University of Melbourne
Melbourne, Australia
2 h-index
4 publications
62 citations
University of South Africa
Pretoria, South Africa
2 h-index
3 publications
38 citations
Carnegie Mellon University
Pittsburgh, United States
2 h-index
2 publications
57 citations
Pohang University of Science and Technology
Pohang, South Korea
2 h-index
2 publications
51 citations
Bandung Institute of Technology
Bandung, Indonesia
1 h-index
1 publications
14 citations
University of Pennsylvania
Philadelphia, United States
1 h-index
1 publications
13 citations
National Institute of Information and Communications Technology
Tokyo, Japan
1 h-index
3 publications
87 citations
1–8 of 49
Venues
- arXiv (Cornell University)
Repository · 3 publications · 42 citations
3
h-index
- LDV-Forum/Journal for language technology and computational linguistics
2 publications · 44 citations
2
h-index
- Zhongwen xinxi xuebao
2 publications · 40 citations
2
h-index
- ACM Transactions on Asian and Low-Resource Language Information Processing
2 publications · 92 citations
2
h-index
- The Prague Bulletin of Mathematical Linguistics
1 publications · 19 citations
1
h-index
1–5