2018 · 37 citations · 45 references
ComputingComputer ScienceHigh-performance ComputingCompilersComputer ArchitectureParallel ComputingData Locality OptimizationData ParallelismGraphics Processing Unit ArchitectureGraphics Processing Unit ComputingGraphics Processing UnitsMemory Hierarchy OptimizationData Layout OptimizationGpu ArchitectureMemory Hierarchy PerformanceMemory Locality OptimizationPerformance PortabilitySpatial LocalitySpatial Locality ExploitationStencil Computation
Achieving high performance on stencil computations poses a number of challenges on modern architectures. The optimization strategy varies significantly across architectures, types of stencils, and types of applications. The standard approach to adapting stencil computations to different architectures, used by both compilers and application programmers, is through the use of iteration space tiling, whereby the data footprint of the computation and its computation partitioning are adjusted to match the memory hierarchy and available parallelism of different platforms. In this paper, we explore an alternative performance portability strategy for stencils, a data layout library for stencils called bricks, that adapts data footprint and parallelism through fine-grained data blocking. Bricks are designed to exploit the inherent multi-dimensional spatial locality of stencils, facilitating improved code generation that can adapt to CPUs or GPUs, and reducing pressure on the memory system. We demonstrate that bricks are performance-portable across CPU and GPU architectures and afford performance advantages over various tiling strategies, particularly for modern multi-stencil and high-order stencil computations. For a range of stencil computations, we achieve high performance on both the Intel Knights Landing (Xeon Phi) and Skylake (Xeon) CPUs as well as the NVIDIA P100 (Pascal) GPU delivering up to a 5× speedup against tiled code.
45
Samuel Williams, Andrew Waterman, David A. Patterson · Communications of the ACM · 2009 · 2.4K citations · Full text
Jonathan Ragan‐Kelley, Connelly Barnes, Andrew Adams et al. · 2013 · 895 citations
3D finite difference computation on GPUs using CUDA
Paulius Micikevicius · 2009 · 518 citations
Yuan Tang, Rezaul Chowdhury, Bradley C. Kuszmaul et al. · 2011 · 338 citations · Full text