Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · 2022 · 10 citations · 30 references
ComputingComputer ScienceMachine LearningRecommender SystemsUser Experience DesignEvaluation Of Recommender SystemsRecommendation EvaluationRecommendation SystemsAdaptive RecommendationBandit AlgorithmsEvaluation MetricsInteractive EvaluationInteractive RecommendationMulti-armed Bandit RecommendationStatistical Methods For ValidationStatistical Validation
Nowadays, most e-commerce and entertainment services have adopted interactive Recommender Systems (RS) to guide the entire journey of users into the system. This task has been addressed as a Multi-Armed Bandit problem where systems must continuously learn and recommend at each iteration. However, despite the recent advances, there is still a lack of consensus on the best practices to evaluate such bandit solutions. Several variables might affect the evaluation process, but most of the works have only been concerned about the accuracy of each method. Thus, this work proposes an interactive RS framework named iRec. It covers the whole experimentation process by following the main RS guidelines. The iRec provides three modules to prepare the dataset, create new recommendation agents, and simulate the interactive scenario. Moreover, it also contains several state-of-the-art algorithms, a hyperparameter tuning module, distinct evaluation metrics, different ways of visualizing the results, and statistical validation.
30
A contextual-bandit approach to personalized news article recommendation
Lihong Li, Wei Chu, John Langford et al. · 2010 · 2.5K citations · Full text
Deep Interest Network for Click-Through Rate Prediction
Guorui Zhou, Xiaoqiang Zhu, Chenru Song et al. · 2018 · 2K citations
Performance of recommender algorithms on top-n recommendation tasks
Paolo Cremonesi, Yehuda Koren, Roberto Turrin · 2010 · 1.4K citations
Using confidence bounds for exploitation-exploration trade-offs
Peter Auer · 2003 · 1.3K citations
Collaborative Denoising Auto-Encoders for Top-N Recommender Systems
Yao Wu, Christopher DuBois, Alice X. Zheng et al. · 2016 · 1K citations