2015 · 14 citations · 16 references
ComputingComputer ScienceInformation TechnologyData MiningInformation RetrievalRecommender SystemsOnline RecommendationPersonalized SearchRecommendation SystemsSearch AnalyticsSearch SystemsWeb SearchBandit Algorithms For RecommendationMulti-armed Bandit OptimizationMulti-armed Bandit RecommendationQuery RecommendationQuery SuggestionsSamplingThompson SamplingUser Feedback
Query suggestions have been a valuable feature for e-commerce sites in helping shoppers refine their search intent. In this paper, we develop an algorithm that helps e-commerce sites like eBay mingle the output of different recommendation algorithms. Our algorithm is based on "Thompson Sampling" --- a technique designed for solving multi-arm bandit problems where the best results are not known in advance but instead are tried out to gather feedback. Our approach is to treat query suggestions as a competition among data resources: we have many query suggestion candidates competing for limited space on the search results page. An "arm" is played when a query suggestion candidate is chosen for display, and our goal is to maximize the expected reward (user clicks on a suggestion). Our experiments have shown promising results in using the click-based user feedback to drive success by enhancing the quality of query suggestions.
16
A contextual-bandit approach to personalized news article recommendation
Lihong Li, Wei Chu, John Langford et al. · 2010 · 2.5K citations · Full text
Asymptotically efficient adaptive allocation rules
Tze-Leung Lai, Herbert Robbins · Advances in Applied Mathematics · 1985 · 2.5K citations