IEEE Transactions on Circuits and Systems I Regular Papers · 2018 · 165 citations · 51 references
EngineeringComputer EngineeringElectrical EngineeringMachine LearningMicroelectronicsSemiconductor DevicesDeep LearningMemory DevicesNeural CircuitsNeural NetworksBackpropagationGradient DescentHierarchical Memory ArchitectureLong Short-term Memory NetworksMemristive CircuitsMemristive Crossbar ArraysMemristive MemoryTemporal Memory
The on-chip implementation of learning algorithms would speed up the training of neural networks in crossbar arrays. The circuit level design and implementation of a back-propagation algorithm using gradient descent operation for neural network architectures is an open problem. In this paper, we propose analog backpropagation learning circuits for various memristive learning architectures, such as deep neural network, binary neural network, multiple neural network, hierarchical temporal memory, and long short-term memory. The circuit design and verification are done using TSMC 180-nm CMOS process models and TiO2-based memristor models. The application level validations of the system are done using XOR problem, MNIST character, and Yale face image databases.
51
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Dmitri B. Strukov, Gregory S. Snider, Duncan R. Stewart et al. · Nature · 2008 · 11.5K citations
Engineering, Electrical Engineering, Electronic Materials +5
Edge Computing: Vision and Challenges
Weisong Shi, Jie Cao, Quan Zhang et al. · IEEE Internet of Things Journal · 2016 · 7.9K citations
Klaus Greff, Rupesh K. Srivastava, Jan Koutník et al. · IEEE Transactions on Neural Networks and Learning Systems · 2016 · 6.8K citations · Full text
Artificial neural networks: a tutorial
Abhishek Jain, Jianchang Mao, Khalid Mohiuddin · Computer · 1996 · 4.9K citations