IEEE Journal of Solid-State Circuits · 2022 · 53 citations · 16 references
EngineeringComputer EngineeringComputer ScienceComputer ArchitectureField-programmable Gate ArraysSystem-on-chip DesignAccelerator ArchitectureField-programmable Gate Array ArchitectureHardware AccelerationPower OptimizationAccelerator MicroarchitectureAcceleratorsBitwise OperationsEnergy-efficient Hardware AccelerationNeural Network QuantizationPower-efficient Accelerator DesignPower-performance-area TradeoffsPrecision Scaling
We introduce an area/energy-efficient precision-scalable neural network accelerator architecture. Previous precision-scalable hardware accelerators have limitations such as the under-utilization of multipliers for low bit-width operations and the large area overhead to support various bit precisions. To mitigate the problems, we first propose a bitwise summation, which reduces the area overhead for the bit-width scaling. In addition, we present a channel-wise aligning scheme (CAS) to efficiently fetch inputs and weights from on-chip SRAM buffers and a channel-first and pixel-last tiling (CFPL) scheme to maximize the utilization of multipliers on various kernel sizes. A test chip was implemented in 28-nm CMOS technology, and the experimental results show that the throughput and energy efficiency of our chip are up to 7.7 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> and 1.64 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> higher than those of the state-of-the-art designs, respectively. Moreover, additional 1.5–3.4 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> throughput gains can be achieved using the CFPL method compared to the CAS.
16
In-Datacenter Performance Analysis of a Tensor Processing Unit
Norman P. Jouppi, Cliff Young, Nishant Patil et al. · 2017 · 4.4K citations
Fengfu Li, Bin Liu · arXiv (Cornell University) · 2016 · 761 citations · Full text