IEEE Transactions on Nanotechnology · 2013 · 411 citations · 47 references
EngineeringComputer SystemsElectrical EngineeringNanotechnologySemiconductor DevicesSynaptic PlasticityDevice ModelingMemory DevicesMemristive MaterialsNeural Circuit ModelingSpike-timing-dependent PlasticitySpiking Neural NetworksMemristive CircuitsMemristive MemoryNeuromorphic HardwareNonvolatile MemoryNonvolatile Memory DevicesSpike-timing PlasticitySpiking Network ArchitecturesSpiking Neural Network Models
Memristive nanodevices offer compact multilevel nonvolatile memory but suffer from significant device variability. The authors propose a neural‑network computing paradigm that exploits the devices’ physics and provides virtual immunity to this variability. They implement a spiking neural network with memristive synapses that learns via a simplified spike‑timing dependent plasticity rule and homeostatic threshold adjustment, evaluated through system‑level simulations using an experimentally verified device model. The network achieves character‑recognition performance comparable to traditional supervised networks, tolerates over 50 % dispersion in device parameters, adapts to varied coding schemes, resists read‑disturb effects without stringent conductance control, and thus enables ultra‑adaptive electronic systems.
Memristive nanodevices can feature a compact multilevel nonvolatile memory function, but are prone to device variability. We propose a novel neural network-based computing paradigm, which exploits their specific physics, and which has virtual immunity to their variability. Memristive devices are used as synapses in a spiking neural network performing unsupervised learning. They learn using a simplified and customized "spike timing dependent plasticity" rule. In the network, neurons' threshold is adjusted following a homeostasis-type rule. We perform system level simulations with an experimentally verified model of the memristive devices' behavior. They show, on the textbook case of character recognition, that performance can compare with traditional supervised networks of similar complexity. They also show that the system can retain functionality with extreme variations of various memristive devices' parameters (a relative standard dispersion of more than 50% is tolerated on all device parameters), thanks to the robustness of the scheme, its unsupervised nature, and the capability of homeostasis. Additionally the network can adjust to stimuli presented with different coding schemes, is particularly robust to read disturb effects and does not require unrealistic control on the devices' conductance. These results open the way for a novel design approach for ultraadaptive electronic systems.
47
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Dmitri B. Strukov, Gregory S. Snider, Duncan R. Stewart et al. · Nature · 2008 · 11.5K citations
Engineering, Electrical Engineering, Electronic Materials +5
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Sung Hyun Jo, Ting‐Chang Chang, Idongesit E. Ebong et al. · Nano Letters · 2010 · 4.1K citations
Life Sciences, Electrical Engineering, Materials Science +17
Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs
Henry Markram, Joachim Lübke, Michael Frotscher et al. · Science · 1997 · 3.9K citations · Full text