IEEE Transactions on Neural Networks · 2001 · 264 citations · 35 references
ComputingComputational EngineeringComputer ScienceComputer NetworksMachine LearningOptimizationContinuous SystemsNeural NetworksNonlinear DynamicsNetwork RepresentationNeural Network ModelingNonlinear Dynamic ResponseNonlinear SystemsPolynomial Basis FunctionsRadial Basis Function NetworksStorage Space OptimizationTraining
A technique for approximating a continuous function of n variables with a radial basis function (RBF) neural network is presented. The method uses an n-dimensional raised-cosine type of RBF that is smooth, yet has compact support. The RBF network coefficients are low-order polynomial functions of the input. A simple computational procedure is presented which significantly reduces the network training and evaluation time. Storage space is also reduced by allowing for a nonuniform grid of points about which the RBFs are centered. The network output is shown to be continuous and have a continuous first derivative. When the network is used to approximate a nonlinear dynamic system, the resulting system is bounded-input bounded-output stable. For the special case of a linear system, the RBF network representation is exact on the domain over which it is defined, and it is optimal in terms of the number of distinct storage parameters required. Several examples are presented which illustrate the effectiveness of this technique.
35
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell B. Stinchcombe, Halbert White · Neural Networks · 1989 · 21.2K citations
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., WhiteH. · Neural Networks · 1989 · 9.4K citations
Approximation capabilities of multilayer feedforward networks
Kurt Hornik · Neural Networks · 1991 · 6.1K citations