Generalizations of Mean Square Error Applied to Ridge Regression

Abstract

Summary Hoerl and Kennard (1970) have proposed a method of estimation for multiple regression problems which involves adding small positive quantities to the diagonal of XT X. They use a type of mean square error to justify the procedure. This paper considers some generalizations of mean square error and provides a stronger defence of the method.