2019 · 30 citations · 32 references
ComputingComputer ScienceComputer SystemsArtificial IntelligenceDesign AutomationMachine LearningDeep LearningOptimization For Machine LearningPerformance ModelingPerformance OptimizationQuery OptimizationQuery ProcessingApplication Load BalancingConstraintsCost ModelsLoadMachine Learning Workloads
The number of applications relying on inference from machine learning models, especially neural networks, is already large and expected to keep growing. For instance, Facebook applications issue tens-of-trillions of inference queries per day with varying performance, accuracy, and cost constraints. Unfortunately, today's inference serving systems are neither easy to use nor cost effective. Developers must manually match the performance, accuracy, and cost constraints of their applications to a large design space that includes decisions such as selecting the right model and model optimizations, selecting the right hardware architecture, selecting the right scale-out factor, and avoiding cold-start effects. These interacting decisions are difficult to make, especially when the application load varies over time, applications evolve over time, and the available resources vary over time.
32
In-Datacenter Performance Analysis of a Tensor Processing Unit
Norman P. Jouppi, Cliff Young, Nishant Patil et al. · 2017 · 4.4K citations
The Emergence of Edge Computing
Mahadev Satyanarayanan · Computer · 2017 · 2.5K citations
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent
Feng Niu, Benjamin Recht, Christopher Ré et al. · arXiv (Cornell University) · 2011 · 1.2K citations · Full text