2017 · 20 citations · 31 references
EngineeringComputer EngineeringComputer ScienceHardware-software Co-designInterconnection NetworksParallel ComputingGraphics Processing Unit ArchitectureGraphics Processing Unit ComputingHardware AccelerationInterconnect ArchitectureMemory Hierarchy OptimizationRoutingBandwidthData Redundancy ManagementData Redundancy ReductionGpgpu ComputingGpu ArchitectureMulticast Routing
General Purpose Graphics Processing Units (GPGPUs) are becoming a cost-effective hardware approach for parallel computing. Many executions on the GPGPUs place heavy stress on the memory system, creating network bottlenecks near memory controllers. We observe that data redundancy in communication traffic is common-place across a wide range of GPGPU applications. To exploit the data redundancy, we propose a packet coalescing mechanism to alleviate the network bottlenecks by directly reducing the traffic volume. The key idea is to coalesce multiple packets into one without increasing the packet size when they carry redundant cache blocks. To ensure that the coalesced packets are delivered to their respective destinations, we adopt multicast routing for the interconnection network of GPGPUs. Our coalescing approach yields 15% IPC improvement (up to 112%) in a large-scale GPGPU with 2D mesh across various GPGPU applications, by reducing average memory access time (AMAT) by 15.5% (up to 65.2%) and obtaining network bandwidth savings by 13% (up to 37%). Also, our coalescing approach achieves 7% IPC improvement in the NVIDIA Fermi architecture with the crossbar.
31
Analyzing CUDA workloads using a detailed GPU simulator
Ali Bakhoda, George L. Yuan, Wilson Wai Lun Fung et al. · 2009 · 1.7K citations
A detailed and flexible cycle-accurate Network-on-Chip simulator
Nan Jiang, James Balfour, Daniel Becker et al. · 2013 · 771 citations
Dynamic Warp Formation and Scheduling for Efficient GPU Control Flow
Wilson Wai Lun Fung, Ivan Sham, George L. Yuan et al. · 2007 · 727 citations
GPUs and the Future of Parallel Computing
Stephen W. Keckler, William J. Dally, Brucek Khailany et al. · IEEE Micro · 2011 · 664 citations