2001 · 54 citations · 33 references
ComputingComputer ScienceInformation TechnologyAlgorithmsDatabasesInformation RetrievalInformation Retrieval ArchitectureQuery ProcessingRetrieval ModelsSearch SystemsSearching AlgorithmsWeb SearchLarge-scale Web CrawlingQuery Performance OptimizationRanking AlgorithmsScalable IndexingSearch Engine AlgorithmsSearch Engine IndexingSearch Engine Ranking AlgorithmsSearch Indexing
A metasearch engine is a system that supports unified access to multiple local search engines. Database selection is one of the main challenges in building a large-scale metasearch engine. The problem is to efficiently and accurately determine a small number of potentially useful local search engines to invoke for each user query. In order to enable accurate selection, metadata that reflect the contents of each search engine need to be collected and used. In this paper, we propose a highly scalable and accurate database selection method. This method has several novel features. First, the metadata for representing the contents of all search engines are organized into a single integrated representative, instead of one for each search engine by all existing approaches. Such a representative yields both computation efficiency and storage efficiency. Second, our selection method is based on a theory for ranking search engines optimally. Experimental results indicate that this new ...
33
Accessibility of information on the web
Steve Lawrence, C. Lee Giles · Nature · 1999 · 1.4K citations
Steve Lawrence, C. Lee Giles · Science · 1998 · 974 citations
Real life information retrieval: a study of user queries on the Web
Bernard J. Jansen, Amanda Spink, Judy Bateman et al. · ACM SIGIR Forum · 1998 · 621 citations · Full text