Publication | Closed Access
CHIMERA: A 0.92 TOPS, 2.2 TOPS/W Edge AI Accelerator with 2 MByte On-Chip Foundry Resistive RAM for Efficient Training and Inference
48
Citations
0
References
2021
Year
Unknown Venue
EngineeringMachine LearningHardware AlgorithmComputer ArchitectureHigh-performance ArchitectureSparse Neural NetworkComputing SystemsAdaptive MemoryEfficient TrainingEdge Ai TrainingPerformance ImprovementComputer EngineeringComputer ScienceDeep LearningHardware AccelerationEdge ComputingDomain-specific AcceleratorRram Non-volatilityEndurance Challenges
CHIMERA is the first non-volatile deep neural network (DNN) chip for edge AI training and inference using foundry on-chip resistive RAM (RRAM) macros and no off-chip memory. CHIMERA achieves 0.92 TOPS peak performance and 2.2 TOPS/W. We scale inference to 6x larger DNNs by connecting 6 CHIMERAs with just 4% execution time and 5% energy costs, enabled by communication-sparse DNN mappings that exploit RRAM non-volatility through quick chip wakeup/shutdown (33 µs). We demonstrate the first incremental edge AI training which overcomes RRAM write energy, speed, and endurance challenges. Our training achieves the same accuracy as traditional algorithms with up to 283x fewer RRAM weight update steps and 340x better energy-delay product. We thus demonstrate 10 years of 20 samples/minute incremental edge AI training on CHIMERA.