2006 · 10 citations · 8 references
ComputingComputer ScienceInformation SystemsDatabasesNatural Language ProcessingWeb TechnologiesInformation ExtractionQuery ProcessingAccuracyAutomated Data ExtractionAutomated Query GenerationData AccessHeuristicsSemantic InformationWeb Information ExtractionWrapper Induction
A substantial subset of the Web data follows some kind of underlying structure. Nevertheless, HTML does not contain any schema or semantic information about the data it represents. A program able to provide software applications with a structured view of those semi-structured Web sources is usually called a wrapper. Wrappers are able to accept a query against the source and return a set of structured results, thus enabling applications to access Web data in a similar manner to that of information from databases. A significant problem in this approach arises because Web sources may experiment changes that invalidate the current wrappers. In this paper, we present novel heuristics and algorithms to address this problem. Our approach is based on collecting some query results during wrapper operation. Then, when the source changes, they are used to generate a set of labeled examples that are then provided as input to a wrapper induction algorithm able to regenerate the wrapper. We have tested our methods in several real-world Web data extraction domains, obtaining high accuracy in all the steps of the process.
8
Storing and querying ordered XML using a relational database system
Igor Tatarinov, Stratis D. Viglas, Kevin Beyer et al. · 2002 · 2.3K citations
Extracting structured data from Web pages
Arvind Arasu, Héctor García-Molina · 2003 · 701 citations
A brief survey of web data extraction tools
Alberto H. F. Laender, Berthier Ribeiro‐Neto, Altigran S. da Silva et al. · ACM SIGMOD Record · 2002 · 690 citations
Wrapper induction: Efficiency and expressiveness
Nicholas Kushmerick · Artificial Intelligence · 2000 · 558 citations