Applied Physics Letters · 2023 · 22 citations · 32 references
ComputingComputer ScienceElectrical EngineeringComputational NeuroscienceMachine LearningNeural EngineeringNeural CircuitsNeural NetworksSpiking Neural NetworksSpintronicsIntegrate-and-fire ModelsIntegrate-and-fire Neuron ModelsMagnetic Tunnel JunctionsMagnetic Tunneling JunctionsNeuromorphic HardwareNoise-resilient Circuit DesignSpiking Neuron ModelsStochasticity
The spatiotemporal nature of neuronal behavior in spiking neural networks (SNNs) makes SNNs promising for edge applications that require high energy efficiency. To realize SNNs in hardware, spintronic neuron implementations can bring advantages of scalability and energy efficiency. Domain wall (DW)-based magnetic tunnel junction (MTJ) devices are well suited for probabilistic neural networks given their intrinsic integrate-and-fire behavior with tunable stochasticity. Here, we present a scaled DW-MTJ neuron with voltage-dependent firing probability. The measured behavior was used to simulate a SNN that attains accuracy during learning compared to an equivalent, but more complicated, multi-weight DW-MTJ device. The validation accuracy during training was also shown to be comparable to an ideal leaky integrate and fire device. However, during inference, the binary DW-MTJ neuron outperformed the other devices after Gaussian noise was introduced to the Fashion-MNIST classification task. This work shows that DW-MTJ devices can be used to construct noise-resilient networks suitable for neuromorphic computing on the edge.
32
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning
Mike Davies, Narayan Srinivasa, Tsung-Han Lin et al. · IEEE Micro · 2018 · 3.7K citations
Engineering, Computer Engineering, Computational Neuroscience +16
Chiral spin torque at magnetic domain walls
Kwang‐Su Ryu, Luc Thomas, See‐Hun Yang et al. · Nature Nanotechnology · 2013 · 1.3K citations