ACM Transactions on Architecture and Code Optimization · 2024 · 10 citations · 54 references
ComputingComputer EngineeringComputer ScienceComputer GraphicsComputer VisionRenderingGraphics Processing Unit ArchitectureGraphics Processing UnitsHardware AccelerationLow-power Cache DesignMemory Hierarchy OptimizationRendering PipelineArchitecture Co-designBank ConflictsDeep Learning AcceleratorsHardware Acceleration SupportMemory Bank ConflictsNeural RenderingResource-constrained DevicesRuntime System Architecture
Neural Radiance Field (NeRF) has emerged as a promising alternative for photorealistic rendering. Despite recent algorithmic advancements, achieving real-time performance on today’s resource-constrained devices remains challenging. In this article, we identify the primary bottlenecks in current NeRF algorithms and introduce a unified algorithm-architecture co-design, Potamoi , designed to accommodate various NeRF algorithms. Specifically, we introduce a runtime system featuring a plug-and-play algorithm, SpaRW , which significantly reduces the per-frame computational workload and alleviates compute inefficiencies. Furthermore, our unified streaming pipeline coupled with customized hardware support effectively tames both SRAM and DRAM inefficiencies by minimizing repetitive DRAM access and completely eliminating SRAM bank conflicts. When evaluated against a baseline utilizing a dedicated DNN accelerator, our framework demonstrates a speedup and energy reduction of 53.1× and 67.7×, respectively, all while maintaining high visual quality with less than a 1.0 dB reduction in peak signal-to-noise ratio.
54
Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik et al. · Communications of the ACM · 2021 · 5.8K citations · Full text
3D Gaussian Splatting for Real-Time Radiance Field Rendering
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler et al. · ACM Transactions on Graphics · 2023 · 4.5K citations · Full text
In-Datacenter Performance Analysis of a Tensor Processing Unit
Norman P. Jouppi, Cliff Young, Nishant Patil et al. · 2017 · 4.4K citations
Display of surfaces from volume data
Marc Levoy · IEEE Computer Graphics and Applications · 1988 · 2.4K citations
Computing, Visualization, Rendering +11