A Comparison of Variance Estimators in Nonparametric Regression

Abstract

SUMMARY We compare two estimators of error variance, both based on quadratic forms in the residuals about smoothing spline fits to data. The estimators are compared over the whole range of values of the smoothing parameter as well as for data-based choices of the smoothing parameter. We show that the commonly used estimator of variance has the serious drawback of underestimating the error variance for small choices of the smoothing parameter. This drawback is not shared by a simple, but more computationally intensive, alternative.