2011 · 14 citations · 12 references
ComputingComputer ScienceComputational LinguisticsInformation RetrievalNatural Language ProcessingInformation ExtractionKnowledge ExtractionNews MediaText SegmentationDocument-level Information ExtractionDomain-specific Text SegmentationInformation Extraction From TextNews ProcessingPage SegmentationPublication Date
We tackle the task of news webpage segmentation, specifically identifying the news title, publication date and story body. While there are very good results in the literature, most of them rely on webpage rendering, which is a very time-consuming step. We focus on scenarios with a high volume of documents, where performance is a must. The chosen approach extends our previous work in the area, combining structural properties with hints of visual presentation styles, computed with a quicker method than regular rendering, and machine learning algorithms. In our experiments, we took special attention to some aspects that are often overlooked in the literature, such as processing time and the generalization of the extraction results for unseen domains. Our approach has shown to be about an order of magnitude faster than an equivalent full rendering alternative while retaining a good quality of extraction.
12
Mark Hall, Eibe Frank, Geoffrey Holmes et al. · ACM SIGKDD Explorations Newsletter · 2009 · 17.8K citations
A fast and robust method for web page template detection and removal
Karane Vieira, Altigran S. da Silva, Nick Pinto et al. · 2006 · 98 citations
Title extraction from bodies of HTML documents and its application to web page retrieval
Yunhua Hu, Guomao Xin, Ruihua Song et al. · 2005 · 61 citations