Future Internet · 2022 · 21 citations · 29 references
ComputingComputer EngineeringComputer ScienceArtificial IntelligenceComputer ArchitectureMachine LearningAccelerator ArchitectureDeep LearningHardware AccelerationMemory Subsystem DesignNeural NetworksParallel ArchitecturesAccelerator MicroarchitectureAcceleratorsDeep Learning AccelerationDeep Learning AcceleratorsMemory ArraysMemory Circuit DesignParallel Deep LearningParallel Processing
From self-driving cars to detecting cancer, the applications of modern artificial intelligence (AI) rely primarily on deep neural networks (DNNs). Given raw sensory data, DNNs are able to extract high-level features after the network has been trained using statistical learning. However, due to the massive amounts of parallel processing in computations, the memory wall largely affects the performance. Thus, a review of the different memory architectures applied in DNN accelerators would prove beneficial. While the existing surveys only address DNN accelerators in general, this paper investigates novel advancements in efficient memory organizations and design methodologies in the DNN accelerator. First, an overview of the various memory architectures used in DNN accelerators will be provided, followed by a discussion of memory organizations on non-ASIC DNN accelerators. Furthermore, flexible memory systems incorporating an adaptable DNN computation will be explored. Lastly, an analysis of emerging memory technologies will be conducted. The reader, through this article, will: 1—gain the ability to analyze various proposed memory architectures; 2—discern various DNN accelerators with different memory designs; 3—become familiar with the trade-offs associated with memory organizations; and 4—become familiar with proposed new memory systems for modern DNN accelerators to solve the memory wall and other mentioned current issues.
29
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Vivienne Sze, Yu‐Hsin Chen, Tien-Ju Yang et al. · Proceedings of the IEEE · 2017 · 4K citations
Ping Chi, Shuangchen Li, Cong Xu et al. · ACM SIGARCH Computer Architecture News · 2016 · 1.2K citations
PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning
Linghao Song, Xuehai Qian, Hai Li et al. · 2017 · 821 citations
Phase change materials and phase change memory
Simone Raoux, Feng Xiong, Matthias Wuttig et al. · MRS Bulletin · 2014 · 525 citations · Full text
Natural Sciences, Materials Engineering, Materials Science +14