Proceedings of the 31st ACM International Conference on Information & Knowledge Management · 2022 · 131 citations · 59 references
ComputingComputer ScienceData ScienceHuman BehaviorHuman-computer InteractionRecommender SystemsEvaluation Of Recommender SystemsOnline RecommendationRecommendation EvaluationRecommendation SystemsHuman-computer Interaction HistoryInteraction HistoryInteraction History AnalysisOffline TestingOnline EvaluationReal-time Recommendation
The progress of recommender systems is hampered mainly by evaluation as it requires real-time interactions between humans and systems, which is too laborious and expensive. This issue is usually approached by utilizing the interaction history to conduct offline evaluation. However, existing datasets of user-item interactions are partially observed, leaving it unclear how and to what extent the missing interactions will influence the evaluation. To answer this question, we collect a fully-observed dataset from Kuaishou's online environment, where almost all 1,411 users have been exposed to all 3,327 items. To the best of our knowledge, this is the first real-world fully-observed data with millions of user-item interactions.
59
Power laws, Pareto distributions and Zipf's law
MEJ Newman · Contemporary Physics · 2005 · 5.8K citations · Full text
Probabilistic Matrix Factorization
Andriy Mnih, Ruslan Salakhutdinov · Neural Information Processing Systems · 2007 · 3.6K citations
Steffen Rendle · 2010 · 3.1K citations
Statistical Analysis With Missing Data
Subir Ghosh · Technometrics · 1988 · 1.6K citations
Evaluating Kolmogorov's Distribution
George Marsaglia, Wai Wan Tsang, Jingbo Wang · Journal of Statistical Software · 2003 · 985 citations · Full text