2002 · 14 citations · 11 references
ComputingComputer ScienceInformation SystemsData MiningNatural Language ProcessingText AnalyticsInformation ExtractionKnowledge ExtractionWeb MiningLegacy SystemsWeb CrawlingWeb Information Extraction
As the Web grows, more and more data has become available under dynamic forms of publication, such as a legacy database accessed by an HTML form (the so called Hidden Web). In situations such as this, integration of this data relies more and more on the fast generation of page fetching agents. As a result, there is an increasing need for tools that can help the user to generate such agents. In this paper, we describe an approach to automatically generating agents to collect hidden Web pages that uses a pre-existing data repository for identifying the contents of these pages and takes the advantage of some regularities that can be found among Web sites. To demonstrate the effectiveness of our approach, we discuss the results of a number of experiments carried out with sites from different domains. We also dicuss how such regularities among sites can be formalized.
11
Steve Lawrence, C. Lee Giles · Science · 1998 · 974 citations
The deep web : Surfacing hidden value
Michael K. Bergman · 2001 · 760 citations · Full text
Sriram Raghavan, Héctor García-Molina · 2001 · 645 citations
Database techniques for the World-Wide Web
Daniela Florescu, Alon Y. Levy, Alberto O. Mendelzon · ACM SIGMOD Record · 1998 · 561 citations · Full text