2016 · 19 citations · 20 references
ComputingComputer ScienceData MiningMachine LearningRecommender SystemsCollaborative FilteringMatrix FactorizationRecommendation SystemsAlternating Least SquaresCustomer RatingsIncremental LearningLeast Squares ApproximationParallel Matrix FactorizationRating Prediction AccuracyRecommender Systems At ScaleScalable Recommendation Systems
Recommender systems play a key role in personalizing service experiences by recommending relevant items to users. One popular technique for producing such personalization at scale is collaborative filtering via Matrix Factorization (MF). The essence of MF is to train a model by factorizing a sparse rating matrix consisting of users' ratings of item. Unfortunately, existing MF methods require model Learning from Scratch when new data (for users, items, or user ratings) arrive. Learning large models from scratch incurs significant computation cost and typically also results in stale recommendations. With increasing amounts of data and a need for real-time recommendations, incremental learning is desirable. In this paper, we develop a novel but simple method for incremental learning of MF models, called One-sided Least Squares, and demonstrate its parallel implementation via Apache Spark. We also describe how to integrate it with batch learning via Alternating Least Squares (ALS). Unlike previous incremental learning methods, we study our method's approximation of the results of ALS, while significantly reducing compute and storage costs. Our theoretical analysis and experimental results on three real-world datasets suggest that One-sided Least Squares achieves prediction accuracy close to Learning from Scratch with ALS at substantially faster learning speeds. This fast and accurate method for incremental learning enables improved Web-scale recommender systems.
20
Matrix Factorization Techniques for Recommender Systems
Yehuda Koren, Robert Bell, Chris Volinsky · Computer · 2009 · 11.7K citations
Spark: cluster computing with working sets
Matei Zaharia, Mosharaf Chowdhury, Michael J. Franklin et al. · 2010 · 4.2K citations
F. Maxwell Harper, Joseph A. Konstan · ACM Transactions on Interactive Intelligent Systems · 2015 · 3.8K citations
A Survey of Collaborative Filtering Techniques
Xiaoyuan Su, Taghi M. Khoshgoftaar · Advances in Artificial Intelligence · 2009 · 3.6K citations · Full text