Sociological Methods & Research · 2016 · 206 citations · 54 references
Public HealthBiostatisticsPredictive AnalyticsPsychometricsStatistical ModelingGoodness-of-fit For Categorical ModelsLog-linear ModelsLogistic Regression ApproachesModel ComparisonModel Fit AssessmentDependent VariablesExplained VarianceGoodness-of-fitGoodness-of-fit IndicesGoodness-of-fit TestsLogistic RegressionModel Evaluation MetricsOrdinary Least Squares
The literature proposes numerous so-called pseudo- R 2 measures for evaluating “goodness of fit” in regression models with categorical dependent variables. Unlike ordinary least square- R 2 , log-likelihood-based pseudo- R 2 s do not represent the proportion of explained variance but rather the improvement in model likelihood over a null model. The multitude of available pseudo- R 2 measures and the absence of benchmarks often lead to confusing interpretations and unclear reporting. Drawing on a meta-analysis of 274 published logistic regression models as well as simulated data, this study investigates fundamental differences of distinct pseudo- R 2 measures, focusing on their dependence on basic study design characteristics. Results indicate that almost all pseudo- R 2 s are influenced to some extent by sample size, number of predictor variables, and number of categories of the dependent variable and its distribution asymmetry. Hence, an interpretation by goodness-of-fit benchmark values must explicitly consider these characteristics. The authors derive a set of goodness-of-fit benchmark values with respect to ranges of sample size and distribution of observations for this measure. This study raises awareness of fundamental differences in characteristics of pseudo- R 2 s and the need for greater precision in reporting these measures.
54
Multiple regression: testing and interpreting interactions
Choice Reviews Online · 1992 · 37.2K citations
Bayesian Model Selection in Social Research
Adrian E. Raftery · Sociological Methodology · 1995 · 6.9K citations
Computing, Biostatistics, Sociology +17