2003 · 24 citations · 15 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningOptimizationClassificationError-based LearningNeural NetworksOptimization For Machine LearningPattern RecognitionBackpropagationFeedforward Neural NetworksMean Absolute ErrorMultilayer NetworksMultilayer PerceptronNeural Network Classification
This paper presents the results of a comparative study on the impact of various error functions in multilayer feedforward neural networks used for classification problems. The objective is the comparison of the properties of the error functions, both in terms of the training speed and the generalization ability. In an effort to avoid complexities introduced by more advanced learning algorithms, the simple backpropagation with momentum algorithm has been employed. A member of classification problems were solved with neural networks that have been trained with the usual mean square error function, the mean absolute error function, the cross-entropy or maximum likelihood function, the Kalman-Kwasny error function (1991), as well as a novel error function designed by the authors. The results indicate that, in most problems examined, an error function other than the usual mean square gives a better performance, both in terms of the number of epochs needed for training, as well as the obtained generalization ability of the trained network.
15
An introduction to computing with neural nets
Richard P. Lippmann · IEEE ASSP Magazine · 1987 · 7.9K citations
Neural networks: A comprehensive foundation
Ryszard Tadeusiewicz · Control Engineering Practice · 1995 · 7.3K citations
Introduction to the theory of neural computation
Neural Networks · 1994 · 6.5K citations
A scaled conjugate gradient algorithm for fast supervised learning
Martin F. Møller · Neural Networks · 1993 · 4.1K citations