IEEE Transactions on Neural Networks · 1993 · 127 citations · 13 references
ComputingComputer EngineeringComputer ScienceArtificial IntelligenceComputer ArchitectureMachine LearningNeural NetworksPattern RecognitionBackpropagationFast LearningMultilayer PerceptronRecognition ProblemsShift RegistersTest Cases
Multilayer perceptrons (MLPs) with weight values restricted to powers of two or sums of powers of two are introduced. In a digital implementation, these neural networks do not need multipliers but only shift registers when computing in forward mode, thus saving chip area and computation time. A learning procedure, based on backpropagation, is presented for such neural networks. This learning procedure requires full real arithmetic and therefore must be performed offline. Some test cases are presented, concerning MLPs with hidden layers of different sizes, on pattern recognition problems. Such tests demonstrate the validity and the generalization capability of the method and give some insight into the behavior of the learning algorithm.
13
An introduction to computing with neural nets
Richard P. Lippmann · IEEE ASSP Magazine · 1987 · 7.9K citations
Increased rates of convergence through learning rate adaptation
Robert A. Jacobs · Neural Networks · 1988 · 1.8K citations
Accelerating the convergence of the back-propagation method
Thomas P. Vogl, J. K. Mangis, A. K. Rigler et al. · Biological Cybernetics · 1988 · 1.1K citations