2011 · 283 citations · 7 references
ComputingComputer ScienceHigh-performance ComputingData MiningMachine LearningParallel ComputingData ParallelismDistributed AlgorithmsDistributed ComputingParallel ArchitecturesScalable Algorithm DesignScalable Machine LearningBelief PropagationClusteringDistributed Machine LearningMapreduceMapreduce AlgorithmsModel ComplexityParallel Machine LearningParallelization
This tutorial gives a broad view of modern approaches for scaling up machine learning and data mining methods on parallel/distributed platforms. Demand for scaling up machine learning is task-specific: for some tasks it is driven by the enormous dataset sizes, for others by model complexity or by the requirement for real-time prediction. Selecting a task-appropriate parallelization platform and algorithm requires understanding their benefits, trade-offs and constraints. This tutorial focuses on providing an integrated overview of state-of-the-art platforms and algorithm choices. These span a range of hardware options (from FPGAs and GPUs to multi-core systems and commodity clusters), programming frameworks (including CUDA, MPI, MapReduce, and DryadLINQ), and learning settings (e.g., semi-supervised and online learning). The tutorial is example-driven, covering a number of popular algorithms (e.g., boosted trees, spectral clustering, belief propagation) and diverse applications (e.g., recommender systems and object recognition in vision).
7
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
Mining high-speed data streams
Pedro Domingos, Geoff Hulten · 2000 · 2.2K citations · Full text
From RankNet to LambdaRank to LambdaMART: An Overview
Christopher J. C. Burges · 2010 · 1K citations