Neural Computation · 1993 · 177 citations · 26 references
ComputingComputer ScienceMathematicsAlgorithmsDynamical SystemsMachine LearningContinual LearningNeural NetworksSignal ProcessingAdaptive FilteringAdaptive FiltersFeedforward Neural NetworksFiltersLinear FilteringNonlinear FilteringRecursive FilterRecursive Filtering
The paper proposes a general framework that encompasses the training of neural networks and the adaptation of filters. We show that neural networks can be considered as general nonlinear filters that can be trained adaptively, that is, that can undergo continual training with a possibly infinite number of time-ordered examples. We introduce the canonical form of a neural network. This canonical form permits a unified presentation of network architectures and of gradient-based training algorithms for both feedforward networks (transversal filters) and feedback networks (recursive filters). We show that several algorithms used classically in linear adaptive filtering, and some algorithms suggested by other authors for training neural networks, are special cases in a general classification of training algorithms for feedback networks.
26
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell B. Stinchcombe, Halbert White · Neural Networks · 1989 · 21.2K citations
Savitzky-Golay Smoothing Filters
William H. Press, Saul A. Teukolsky · Computers in Physics · 1990 · 11.8K citations · Full text
Jeffrey L. Elman · Cognitive Science · 1990 · 10.8K citations
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., WhiteH. · Neural Networks · 1989 · 9.4K citations