2022 · 18 citations · 135 references
ComputingComputer EngineeringComputer ScienceAlgorithmsArtificial IntelligenceMachine LearningData Movement OptimizationGraphics Processing Unit ComputingNeural NetworksEnergy ConsumptionProcess Energy ConsumptionProcessor SystemsTraining
Machine learning (ML) algorithms [1]–[6] have become ubiquitous in many fields of science and technology due to their ability to learn from and improve with experience with minimal human intervention. These algorithms train by updating their model parameters in an iterative manner to improve the overall prediction accuracy. However, training machine learning algorithms is a computation-ally intensive process, which requires large amounts of training data. Accessing training data in current processor-centric systems (e.g., CPU, GPU) implies costly data movement between memory and processors, which results in high energy consumption and a large percentage of the total execution cycles. This data movement can become the bottleneck of the training process, if there is not enough computation and locality to amortize its cost.
135
Least squares quantization in PCM
Sheelagh Lloyd · IEEE Transactions on Information Theory · 1982 · 15.6K citations · Full text
TensorFlow: A system for large-scale machine learning
Martı́n Abadi, Paul Barham, Jianmin Chen et al. · arXiv (Cornell University) · 2016 · 8.8K citations · Full text
In-Datacenter Performance Analysis of a Tensor Processing Unit
Norman P. Jouppi, Cliff Young, Nishant Patil et al. · 2017 · 4.4K citations
Ali Shafiee, Anirban Nag, Naveen Muralimanohar et al. · ACM SIGARCH Computer Architecture News · 2016 · 1.5K citations
Ping Chi, Shuangchen Li, Cong Xu et al. · ACM SIGARCH Computer Architecture News · 2016 · 1.2K citations