2013 · 54 citations · 26 references
EngineeringComputer EngineeringComputer ScienceComputer ArchitectureHardware-software Co-designParallel ComputingHardware AccelerationMemory Hierarchy DesignMemory Hierarchy OptimizationMemory Subsystem DesignPower ManagementPower-aware DesignData PlacementEnergy-efficient Gpu ComputingEnergy-efficient Gpu DesignGpu ArchitectureGpu MicroarchitectureHybrid Memory ArchitecturesMemory Co-designPhase-change Memory
Abstract—Hybrid memory designs, such as DRAM plus Phase Change Memory (PCM), have shown some promise for alleviating power and density issues faced by traditional memory systems. But previous studies have concentrated on CPU systems with a modest level of parallelism. This work studies the problem in a massively parallel setting. Specifically, it investigates the special implications to hybrid memory imposed by the massive parallelism in GPU. It empirically shows that, contrary to promising results demonstrated for CPU, previous designs of PCM-based hybrid memory result in significant degradation to the energy efficiency of GPU. It reveals that the fundamental reason comes from a multi-facet mismatch between those designs and the massive parallelism in GPU. It presents a solution that centers around a close cooperation between compiler-directed data placement and hardware-assisted runtime adaptation. The co-design approach helps tap into the full potential of hybrid memory for GPU without requiring dramatic hardware changes over previous designs, yielding 6 % and 49 % energy saving on average compared to pure DRAM and pure PCM respectively, and keeping performance loss less than 2%. Index Terms—GPU; NVRAM; Co-Design; Energy Effi-ciency I.
26
Rodinia: A benchmark suite for heterogeneous computing
Shuai Che, Michael Boyer, Jiayuan Meng et al. · 2009 · 3K citations
Analyzing CUDA workloads using a detailed GPU simulator
Ali Bakhoda, George L. Yuan, Wilson Wai Lun Fung et al. · 2009 · 1.7K citations
Architecting phase change memory as a scalable dram alternative
Benjamin C. Lee, Engin İpek, Onur Mutlu et al. · 2009 · 1.4K citations