Proceedings of the 59th ACM/IEEE Design Automation Conference · 2022 · 17 citations · 12 references
EngineeringComputer EngineeringComputer ScienceComputational NeuroscienceComputer VisionNeural EngineeringDeep LearningHardware AccelerationNetwork-on-chip DesignNeural EncodingSpiking Neural NetworksActivationCmos ScalingDeep Spiking Neural NetworksEnergy-efficient ComputationNeuromorphic HardwareRepresentation ErrorSpike CodingSpiking Network Architectures
In this paper, we present an energy-efficient SNN architecture, which can seamlessly run deep spiking neural networks (SNNs) with improved accuracy. First, we propose a conversion aware training (CAT) to reduce ANN-to-SNN conversion loss without hardware implementation overhead. In the proposed CAT, the activation function developed for simulating SNN during ANN training, is efficiently exploited to reduce the data representation error after conversion. Based on the CAT technique, we also present a time-to-first-spike coding that allows lightweight logarithmic computation by utilizing spike time information. The SNN processor design that supports the proposed techniques has been implemented using 28nm CMOS process. The processor achieves the top-1 accuracies of 91.7%, 67.9% and 57.4% with inference energy of 486.7uJ, 503.6uJ, and 1426uJ to process CIFAR-10, CIFAR-100, and Tiny-ImageNet, respectively, when running VGG-16 with 5bit logarithmic weights.
12
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning
Mike Davies, Narayan Srinivasa, Tsung-Han Lin et al. · IEEE Micro · 2018 · 3.7K citations
Engineering, Computer Engineering, Computational Neuroscience +16
In-Datacenter Performance Analysis of a Tensor Processing Unit
Norman P. Jouppi, Cliff Young, Nishant Patil et al. · ACM SIGARCH Computer Architecture News · 2017 · 1.3K citations · Full text