Nature Communications · 2024 · 53 citations · 69 references
Life SciencesComputer EngineeringComputer SystemsEdge ComputingNeural CircuitryNeural EngineeringEdge ArchitectureMemory DevicesMemristive MaterialsNeural CircuitsSpiking Neural NetworksBrain Circuit ArchitectureCmos ScalingNeuromorphic DevicesNeuromorphic HardwareScalable Edge SystemsSmall-world Network ArchitectureSpiking Network Architectures
The brain's connectivity is locally dense and globally sparse, forming a small-world graph-a principle prevalent in the evolution of various species, suggesting a universal solution for efficient information routing. However, current artificial neural network circuit architectures do not fully embrace small-world neural network models. Here, we present the neuromorphic Mosaic: a non-von Neumann systolic architecture employing distributed memristors for in-memory computing and in-memory routing, efficiently implementing small-world graph topologies for Spiking Neural Networks (SNNs). We've designed, fabricated, and experimentally demonstrated the Mosaic's building blocks, using integrated memristors with 130 nm CMOS technology. We show that thanks to enforcing locality in the connectivity, routing efficiency of Mosaic is at least one order of magnitude higher than other SNN hardware platforms. This is while Mosaic achieves a competitive accuracy in a variety of edge benchmarks. Mosaic offers a scalable approach for edge systems based on distributed spike-based computing and in-memory routing.
69
Collective dynamics of ‘small-world’ networks
Duncan J. Watts, Steven H. Strogatz · Nature · 1998 · 43.2K citations
Backpropagation through time: what it does and how to do it
Paul J. Werbos · Proceedings of the IEEE · 1990 · 4.9K citations
In-Datacenter Performance Analysis of a Tensor Processing Unit
Norman P. Jouppi, Cliff Young, Nishant Patil et al. · 2017 · 4.4K citations