2012 · 45 citations · 23 references
ComputingComputer ScienceData ScienceData MiningParallel AlgorithmsRecommender SystemsCollaborative FilteringOnline RecommendationRecommendation EvaluationRecommendation SystemsScalable Data MiningSequential RecommendationMapreduceMapreduce AlgorithmsNeighborhood-based RecommendationPairwise ComparisonParallel Algorithm ScalabilitySimilarity ComputationSimilarity MeasuresTop-n Recommendation
Similarity-based neighborhood methods, a simple and popular approach to collaborative filtering, infer their predictions by finding users with similar taste or items that have been similarly rated. If the number of users grows to millions, the standard approach of sequentially examining each item and looking at all interacting users does not scale. To solve this problem, we develop a MapReduce algorithm for the pairwise item comparison and top-N recommendation problem that scales linearly with respect to a growing number of users. This parallel algorithm is able to work on partitioned data and is general in that it supports a wide range of similarity measures. We evaluate our algorithm on a large dataset consisting of 700 million song ratings from Yahoo! Music.
23
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
Item-based collaborative filtering recommendation algorithms
Badrul Sarwar, George Karypis, Joseph A. Konstan et al. · 2001 · 9K citations
Paul Resnick, Neophytos Iacovou, Mitesh Suchak et al. · 1994 · 5K citations · Full text
Accurate methods for the statistics of surprise and coincidence
Ted Dunning · 1993 · 2.7K citations