Publication | Closed Access
Accelerated focused crawling through online relevance feedback
34
Citations
0
References
2002
Year
Unknown Venue
EngineeringIntelligent Information RetrievalInteractive SearchSemantic WebText MiningNatural Language ProcessingCrawl FrontierInformation RetrievalData ScienceData MiningRelevance FeedbackLink AnalysisContent AnalysisTag Tree StructureKnowledge DiscoveryHref Source PageComputer ScienceOnline Relevance FeedbackSearch Engine DesignWeb MiningInteractive Information Retrieval
The organization of HTML into a tag tree structure, which is rendered by browsers as roughly rectangular regions with embedded text and HREF links, greatly helps surfers locate and click on links that best satisfy their information need. Can an automatic program emulate this human behavior and thereby learn to predict the relevance of an unseen HREF target page w.r.t. an information need, based on information limited to the HREF source page? Such a capability would be of great interest in focused crawling and resource discovery, because it can fine-tune the priority of unvisited URLs in the crawl frontier, and reduce the number of irrelevant pages which are fetched and discarded.