2005 · 107 citations · 18 references
ComputingComputer ScienceKnowledge RepresentationNatural Language ProcessingText AnalyticsData SummarizationInformation ExtractionKnowledge ExtractionText SummarizationClickthrough AnalysisDocument SummarizationHidden KnowledgeImplicit KnowledgeSummarizationSummarization DatasetsSummarization Evaluation
Most previous Web-page summarization methods treat a Web page as plain text. However, such methods fail to uncover the full knowledge associated with a Web page needed in building a high-quality summary, because many of these methods do not consider the hidden relationships in the Web. Uncovering the hidden knowledge is important in building good Web-page summarizers. In this paper, we extract the extra knowledge from the clickthrough data of a Web search engine to improve Web-page summarization. Wefirst analyze the feasibility in utilizing the clickthrough data to enhance Web-page summarization and then propose two adapted summarization methods that take advantage of the relationships discovered from the clickthrough data. For those pages that are not covered by the clickthrough data, we design a thematic lexicon approach to generate implicit knowledge for them. Our methods are evaluated on a dataset consisting of manually annotated pages as well as a large dataset that is crawled from the Open Directory Project website. The experimental results indicate that significant improvements can be achieved through our proposed summarizer as compared to the summarizers that do not use the clickthrough data.
18
The Automatic Creation of Literature Abstracts
H. P. Luhn · IBM Journal of Research and Development · 1958 · 3.2K citations
Using Linear Algebra for Intelligent Information Retrieval
Michael W. Berry, Susan Dumais, Gavin O'Brien · SIAM Review · 1995 · 1.5K citations
Advances in Automatic Text Summarization
Elizabeth D. Liddy · Information Retrieval · 2001 · 693 citations