Journal of Business and Economic Statistics · 2015 · 486 citations · 26 references
BusinessDecision SciencesEconometricsForecastingPredictive AnalyticsForecast EvaluationForecasting MethodsHypothesis TestingInferential StatisticsModel ComparisonTest ValidityAccuracyForecast Comparison TestsForecast Model ComparisonForecast Performance EvaluationPredictive Model PerformancePredictive PerformancePredictive Performance EvaluationPseudo Out-of-sample Forecasting
The Diebold–Mariano (DM) test was intended for comparing forecasts; it has been, and remains, useful in that regard. The DM test was not intended for comparing models. Much of the large ensuing literature, however, uses DM-type tests for comparing models, in pseudo-out-of-sample environments. In that case, simpler yet more compelling full-sample model comparison procedures exist; they have been, and should continue to be, widely used. The hunch that pseudo-out-of-sample analysis is somehow the “only,” or “best,” or even necessarily a “good” way to provide insurance against in-sample overfitting in model comparisons proves largely false. On the other hand, pseudo-out-of-sample analysis remains useful for certain tasks, perhaps most notably for providing information about comparative predictive performance during particular historical episodes.
26
Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
Quang Vuong · Econometrica · 1989 · 6K citations
Francis X. Diebold, Roberto S. Mariano · Journal of Business and Economic Statistics · 1995 · 4.8K citations