2014 · 47 citations · 22 references
ComputingComputer ScienceHigh-performance ComputingComputer ArchitectureLow-power DesignParallel ComputingHardware AccelerationMemory Hierarchy OptimizationParallel ArchitecturesParallel Computer ArchitectureParallel Memory ManagementPower ManagementDataflow ProgrammingDataflow Programming ModelsEnergy-efficient Parallel ComputingHardware ResourcesParallel Processing ArchitecturesPower EfficiencyPrefetchingTransactional Memory
Abstract—Modern graphics processing units (GPUs) combine large amounts of parallel hardware with fast context switching among thousands of active threads to achieve high performance. However, such designs do not translate well to mobile environments where power constraints often limit the amount of hardware. In this work, we investigate the use of prefetching as a means to increase the energy efficiency of GPUs. Classically, CPU prefetching results in higher performance but worse energy efficiency due to unnecessary data being brought on chip. Our approach, called APOGEE, uses an adaptive mechanism to dynamically detect and adapt to the memory access patterns found in both graphics and scientific applications that are run on modern GPUs to achieve prefetching efficiencies of over 90%. Rather than examining threads in isolation, APOGEE uses adjacent threads to more efficiently identify address patterns and dynamically adapt the timeliness of prefetching. The net effect of APOGEE is that fewer thread contexts are necessary to hide memory latency and thus sustain performance. This reduction in thread contexts and related hardware translates to simplification of hardware and leads to a reduction in power. For Graphics and GPGPU applications, APOGEE enables an 8X reduction in multithreading hardware, while providing a performance benefit of 19%. This translates to a 52 % increase in performance per watt over systems with high multi-threading and 33 % over existing GPU prefetching techniques.
22
Analyzing CUDA workloads using a detailed GPU simulator
Ali Bakhoda, George L. Yuan, Wilson Wai Lun Fung et al. · 2009 · 1.7K citations
NVIDIA Tesla: A Unified Graphics and Computing Architecture
Erik Lindholm, John Nickolls, Stuart F. Oberman et al. · IEEE Micro · 2008 · 1.3K citations
GPUs and the Future of Parallel Computing
Stephen W. Keckler, William J. Dally, Brucek Khailany et al. · IEEE Micro · 2011 · 664 citations
An integrated GPU power and performance model
Sunpyo Hong, Hyesoon Kim · 2010 · 477 citations