IEEE Transactions on Neural Networks · 1997 · 495 citations · 109 references
ComputingComputer ScienceAlgorithmsArtificial IntelligenceMachine LearningNeural NetworksPattern RecognitionRepresentation LearningFeedforward Neural NetworksNeural Network ModelingNeural Network PredictionRecurrent Neural NetworksSearch Space ExplorationSearch Space ReductionState Space Search
In this survey paper, we review the constructive algorithms for structure learning in feedforward neural networks for regression problems. The basic idea is to start with a small network, then add hidden units and weights incrementally until a satisfactory solution is found. By formulating the whole problem as a state-space search, we first describe the general issues in constructive algorithms, with special emphasis on the search strategy. A taxonomy, based on the differences in the state transition mapping, the training algorithm, and the network architecture, is then presented.
109
Approximation capabilities of multilayer feedforward networks
Kurt Hornik · Neural Networks · 1991 · 6.1K citations
Modeling by shortest data description
J. Rissanen · Automatica · 1978 · 6K citations