Communication in Statistics- Theory and Methods · 2010 · 126 citations · 20 references
Natural SciencesEconomicsEconometricsStatistical ModelingStatisticsBias-variance TradeoffEstimation TheoryParameter EstimationRegressionStatistical InferenceEstimation EquationsEstimation Of Regression ModelsLeast Squares EstimationLinear RegressionMean Squared Error EstimationOrdinary Least SquaresRegression EstimationRidge Regression
This article is concerned with the parameter estimation in linear regression model. To overcome the multicollinearity problem, a new two-parameter estimator is proposed. This new estimator is a general estimator which includes the ordinary least squares (OLS) estimator, the ridge regression (RR) estimator, and the Liu estimator as special cases. Necessary and sufficient conditions for the superiority of the new estimator over the OLS, RR, Liu estimators, and the two-parameter estimator proposed by Ozkale and Kaciranlar (2007 Ozkale , M. R. , Kaciranlar , S. ( 2007 ). The restricted and unrestricted two-parameter estimators . Commun. Statist. Theor. Meth. 36 : 2707 – 2725 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) in the mean squared error matrix (MSEM) sense are derived. Furthermore, we obtain the estimators of the biasing parameters and give a numerical example to illustrate some of the theoretical results.
20
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Arthur E. Hoerl, Robert W. Kennard · Technometrics · 1970 · 1.9K citations