2016 · 292 citations · 38 references
ComputingComputer ScienceInformation RetrievalMachine LearningWeb AnalyticsPersonalized SearchRelevance RankingRetrieval ModelsSearch AnalyticsSearch SystemsWeb SearchClick ModelsLearning To RankLearning To Rank For Personalized SearchOnline ExperimentsOnline Learning To RankQuery-document RelevanceRelevance ModelsSelection Bias Analysis
Click-through data has proven to be a critical resource for improving search ranking quality. Though a large amount of click data can be easily collected by search engines, various biases make it difficult to fully leverage this type of data. In the past, many click models have been proposed and successfully used to estimate the relevance for individual query-document pairs in the context of web search. These click models typically require a large quantity of clicks for each individual pair and this makes them difficult to apply in systems where click data is highly sparse due to personalized corpora and information needs, e.g., personal search. In this paper, we study the problem of how to leverage sparse click data in personal search and introduce a novel selection bias problem and address it in the learning-to-rank framework. This paper proposes a few bias estimation methods, including a novel query-dependent one that captures queries with similar results and can successfully deal with sparse data. We empirically demonstrate that learning-to-rank that accounts for query-dependent selection bias yields significant improvements in search effectiveness through online experiments with one of the world's largest personal search engines.
38
Optimizing search engines using clickthrough data
Thorsten Joachims · 2002 · 3.9K citations
Learning to rank for information retrieval
Tie‐Yan Liu · 2010 · 2K citations
Accurately interpreting clickthrough data as implicit feedback
Thorsten Joachims, Laura Granka, Bing Pan et al. · 2005 · 1.4K citations