IEEE Transactions on Electron Devices · 2023 · 14 citations · 25 references
EngineeringElectrical EngineeringMachine LearningSemiconductor DevicesSemiconductor MaterialsDeep LearningDevice ModelingMemory DevicesMemristive MaterialsNeural Circuit ModelingNeural NetworksConductanceConductionInference AccuracyMatrix MultiplicationMemristive MemoryPhase-change MemoryRetention CharacteristicsStable Set
Analog in-memory computing (AIMC) using memristive devices is considered a promising Non-von Neumann approach for deep learning (DL) inference tasks. However, inaccuracies in the programming of devices, that are attributed to conductance variations, pose a key challenge toward achieving sufficient compute precision for DL inference. Fortunately, conduction variations in memristive devices, such as phase-change memory (PCM) devices, exhibit a strong state dependence. This state dependence can be exploited in synaptic unit cells that comprise more than one memristive device, to encode positive or negative weights. In such multi-memristive unit cells, we propose a method that optimally maps the weights to the device conductance values, by maximizing the number of devices at the stable SET and RESET states. We demonstrate that this method reduces the matrix-vector multiplication (MVM) error and is more resilient to non-ideal device retention characteristics. With this approach, we increase the mean experimental inference accuracy of a network trained for MNIST classification by 0.71% on two PCM-based AIMC cores, and the hardware-realistic simulated top-1 accuracy of a network trained for ImageNet classification by 0.28%, while significantly reducing variability across multiple experiment instances.
25
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Neuromorphic computing with multi-memristive synapses
Irem Boybat, Manuel Le Gallo, S. R. Nandakumar et al. · Nature Communications · 2018 · 864 citations · Full text
Engineering, Computer Engineering, Electrical Engineering +15
A compute-in-memory chip based on resistive random-access memory
Weier Wan, Rajkumar Kubendran, Clemens Schaefer et al. · Nature · 2022 · 833 citations · Full text