2009 · 35 citations · 19 references
ComputingComputer ScienceData ScienceAdvertisingMachine LearningWeb AnalyticsDimensionality ReductionLatent Variable ModelsMatrix FactorizationPersonalizationSearch AdvertisingBenchmark DatasetsClick-through Data ModelingData SparsityLatent Factor ModelsOnline Display AdvertisingPoisson RegressionProbabilistic Latent Factor ModelsSparsity Constraints
We adapt a probabilistic latent variable model, namely GaP (Gamma-Poisson) [6], to ad targeting in the contexts of sponsored search (SS) and behaviorally targeted (BT) display advertising. We also approach the important problem of ad positional bias by formulating a one-latent-dimension GaP factorization. Learning from click-through data is intrinsically large scale, even more so for ads. We scale up the algorithm to terabytes of real-world SS and BT data that contains hundreds of millions of users and hundreds of thousands of features, by leveraging the scalability characteristics of the algorithm and the inherent structure of the problem including data sparsity and locality. Specifically, we demonstrate two somewhat orthogonal philosophies of scaling algorithms to large-scale problems, through the SS and BT implementations, respectively. Finally, we report the experimental results using Yahoo’s vast datasets, and show that our approach substantially outperform the state-of-the-art methods in prediction accuracy. For BT in particular, the ROC area achieved by GaP is exceeding 0.95, while one prior approach using Poisson regression [11] yielded 0.83. For computational performance, we compare a single-node sparse implementation with a parallel implementation using Hadoop MapReduce, the results are counterintuitive yet quite interesting. We therefore provide insights into the underlying principles of large-scale learning. 1
19
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
Indexing by latent semantic analysis
Scott Deerwester, Susan Dumais, George W. Furnas et al. · Journal of the American Society for Information Science · 1990 · 12.8K citations
Colin Goodall, Ian T. Jolliffe · Technometrics · 1988 · 8.7K citations