International Statistical Review · 1987 · 280 citations · 24 references
ComputingData ScienceEconometricsStatistical LearningStatistical ModelingInferential StatisticsLikelihood EstimationLikelihood FunctionsParameter EstimationRegressionStatistical InferenceBasis FunctionsComposite LikelihoodFinite-dimensional ApproximationPenalized EstimationPenalized LikelihoodPenalized Likelihood EstimationPenalized RegressionSemi-parametric Regression
Summary This paper examines penalized likelihood estimation in the context of general regression problems, characterized as probability models with composite likelihood functions. The emphasis is on the common situation where a parametric model is considered satisfactory but for inhomogeneity with respect to a few extra variables. A finite-dimensional formulation is adopted, using a suitable set of basis functions. Appropriate definitions of deviance, degrees of freedom, and residual are provided, and the method of cross-validation for choice of the tuning constant is discussed. Quadratic approximations are derived for all the required statistics.
24
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text
J. A. Nelder, R. W. M. Wedderburn · Journal of the Royal Statistical Society Series A (General) · 1972 · 7.2K citations
N. Aronszajn · Transactions of the American Mathematical Society · 1950 · 5.4K citations · Full text
Smoothing noisy data with spline functions
Peter G. Craven, Grace Wahba · Numerische Mathematik · 1978 · 3.4K citations
Residuals and Influence in Regression
Robert F. Ling, R. Dennis Cook, Sanford Weisberg · Technometrics · 1984 · 2.7K citations · Full text