Technometrics · 1998 · 29 citations · 10 references
ComputingComputer ScienceMathematicsMachine LearningPredictive AnalyticsStatistical LearningNeural NetworksOverfittingPredictive ModelingTime Series PredictionUnderfittingWeight EstimationNeural Network PredictionNonlinear RegressionNonlinear Regression ModelsPrediction Interval EstimationPrediction Interval EvaluationPrediction IntervalsWeight Decay
Standard methods for computing prediction intervals in nonlinear regression can be effectively applied to neural networks when the number of training points is large. Simulations show, however, that these methods can generate unreliable prediction intervals on smaller datasets when the network is trained to convergence. Stopping the training algorithm prior to convergence, to avoid overfitting, reduces the effective number of parameters but can lead to prediction intervals that are too wide. We present an alternative approach to estimating prediction intervals using weight decay to fit the network and show via a simulation study that this method may be effective in overcoming some of the shortcomings of the other approaches.
10
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell B. Stinchcombe, Halbert White · Neural Networks · 1989 · 21.2K citations
Linear Smoothers and Additive Models
Andreas Buja, Trevor Hastie, Robert Tibshirani · The Annals of Statistics · 1989 · 1K citations · Full text
Advances in Neural Information Processing Systems 7
G. Tesauro, David S. Touretzky, Todd K. Leen · 1995 · 873 citations