Design, Automation, and Test in Europe · 2015 · 50 citations · 11 references
EngineeringComputer EngineeringComputer ScienceHardware-software Co-designMachine LearningSemiconductor DevicesDevice ScalingHardware AccelerationIntegrated Circuit DesignMemristive MaterialsOptimization For Machine LearningPower OptimizationCrosspoint Array OptimizationEnergy ConsumptionInterconnect Resistance ReductionMachine Learning AccelerationMemristive Crossbar ArraysParallel OperationsSparse CodingTraining
The authors propose a technology‑design co‑optimization framework and reverse‑scaling rules for resistive cross‑point arrays to enable high‑accuracy machine‑learning inference and training on chip. They implement a novel parallel read/write scheme, co‑optimize wire width and multi‑cell weight encoding, and fabricate the array with peripheral circuitry at 65 nm, benchmarking it on MNIST. The resulting accelerator delivers over a thousand‑fold speed‑up and a million‑fold energy‑efficiency gain versus CPU software, supporting real‑time handwritten‑digit recognition.
Technology-design co-optimization methodologies of the resistive cross-point array are proposed for implementing the machine learning algorithms on a chip. A novel read and write scheme is designed to accelerate the training process, which realizes fully parallel operations of the weighted sum and the weight update. Furthermore, technology and design parameters of the resistive cross-point array are co-optimized to enhance the learning accuracy, latency and energy consumption, etc. In contrast to the conventional memory design, a set of reverse scaling rules is proposed on the resistive cross-point array to achieve high learning accuracy. These include 1) larger wire width to reduce the IR drop on interconnects thereby increasing the learning accuracy; 2) use of multiple cells for each weight element to alleviate the impact of the device variations, at an affordable expense of area, energy and latency. The optimized resistive cross-point array with peripheral circuitry is implemented at the 65 nm node. Its performance is benchmarked for handwritten digit recognition on the MNIST database using gradient-based sparse coding. Compared to state-of-the-art software approach running on CPU, it achieves >103 speed-up and >106 energy efficiency improvement, enabling real-time image feature extraction and learning.
11
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Sung Hyun Jo, Ting‐Chang Chang, Idongesit E. Ebong et al. · Nano Letters · 2010 · 4.1K citations
Life Sciences, Electrical Engineering, Materials Science +17