Companion Proceedings of the Web Conference 2022 · 2022 · 14 citations · 25 references
ComputingComputer ScienceBehavior AnalysisMachine LearningRecommender SystemsCollaborative FilteringEvaluation Of Recommender SystemsRecommendation EvaluationRecommendation SystemsSoftware TestingBlack-box TestingMachine Learning ClassificationPlug-and-play ModulesRanking MetricsRecommender Evaluation Metrics
As with most Machine Learning systems, recommender systems are typically evaluated through performance metrics computed over held-out data points. However, real-world behavior is undoubtedly nuanced: ad hoc error analysis and tests must be employed to ensure the desired quality in actual deployments. We introduce RecList, a testing methodology providing a general plug-and-play framework to scale up behavioral testing. We demonstrate its capabilities by analyzing known algorithms and black-box APIs, and we release it as an open source, extensible package for the community.
25
Efficient Estimation of Word Representations in Vector Space
Tomáš Mikolov, Kai Chen, Greg S. Corrado et al. · arXiv (Cornell University) · 2013 · 11.7K citations · Full text
F. Maxwell Harper, Joseph A. Konstan · ACM Transactions on Interactive Intelligent Systems · 2015 · 3.8K citations
Neural Graph Collaborative Filtering
2019 · 3K citations · Full text