Nature Communications · 2024 · 107 citations · 46 references
EngineeringComputer EngineeringComputer ScienceEmbedded SystemsHardware-software Co-designNeural EngineeringNeural Circuit DynamicsSpiking Neural NetworksEnergy-efficient Artificial IntelligenceEnergy-efficient ComputationEvent-driven ComputationLow-power Processor DesignNeuromorphic DevicesNeuromorphic HardwareSpike-based Signal ProcessingSpiking Activity
By mimicking the neurons and synapses of the human brain and employing spiking neural networks on neuromorphic chips, neuromorphic computing offers a promising energy-efficient machine intelligence. How to borrow high-level brain dynamic mechanisms to help neuromorphic computing achieve energy advantages is a fundamental issue. This work presents an application-oriented algorithm-software-hardware co-designed neuromorphic system for this issue. First, we design and fabricate an asynchronous chip called "Speck", a sensing-computing neuromorphic system on chip. With the low processor resting power of 0.42mW, Speck can satisfy the hardware requirements of dynamic computing: no-input consumes no energy. Second, we uncover the "dynamic imbalance" in spiking neural networks and develop an attention-based framework for achieving the algorithmic requirements of dynamic computing: varied inputs consume energy with large variance. Together, we demonstrate a neuromorphic system with real-time power as low as 0.70mW. This work exhibits the promising potentials of neuromorphic computing with its asynchronous event-driven, sparse, and dynamic nature.
46
Advances in neural information processing systems 7
Krzysztof J. Cios, Mark E. Shields · Neurocomputing · 1997 · 22.3K citations
Squeeze-and-Excitation Networks
Jie Hu, Li Shen, Samuel Albanie et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019 · 12.5K citations
Xiaolong Wang, Ross Girshick, Abhinav Gupta et al. · 2018 · 11.2K citations
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning
Mike Davies, Narayan Srinivasa, Tsung-Han Lin et al. · IEEE Micro · 2018 · 3.7K citations
Engineering, Computer Engineering, Computational Neuroscience +16