2005 · 64 citations · 18 references
ComputingComputer ScienceComputational LinguisticsInformation RetrievalNatural Language ProcessingCorpus AnalysisInformation ExtractionKeyword ExtractionTerm ExtractionText MiningText SummarizationAutomatic Term ExtractionKey ExtractionText ClassificationUser Study Evaluation
Automatic key phrase extraction is a useful tool in many text related applications such as clustering and summarization. State-of-the-art methods are aimed towards extracting key phrases from traditional text such as technical papers. Application of these methods on Web documents, which often contain diverse and heterogeneous contents, is of particular interest and challenge in the information age. In this work, we investigate the significance of narrative text classification in the task of automatic key phrase extraction in Web document corpora. We benchmark three methods, TFIDF, KEA, and Keyterm, used to extract key phrases from all the plain text and from only the narrative text of Web pages. ANOVA tests are used to analyze the ranking data collected in a user study using quantitative measures of acceptable percentage and quality value. The evaluation shows that key phrases extracted from the narrative text only are significantly better than those obtained from all plain text of Web pages. This demonstrates that narrative text classification is indispensable for effective key phrase extraction in Web document corpora.
18
Authoritative sources in a hyperlinked environment
Jon Kleinberg · Journal of the ACM · 1999 · 9.1K citations · Full text
A simple rule-based part of speech tagger
Eric Brill · 1992 · 1.4K citations · Full text
Ian H. Witten, Gordon W. Paynter, Eibe Frank et al. · 1999 · 870 citations · Full text
Learning Algorithms for Keyphrase Extraction
Peter D. Turney · Information Retrieval · 2000 · 838 citations · Full text