American Journal of Political Science · 2011 · 133 citations · 17 references
ComputingPolitical ScienceVisualizationData VisualizationPredictive AnalyticsVisual AnalyticsCategorical Data VisualizationStatistical GraphicsStatistical VisualizationProbability ThresholdsProbability VisualizationProbit Regression
We present a visual method for assessing the predictive power of models with binary outcomes. This technique allows the analyst to evaluate model fit based upon the models’ ability to consistently match high‐probability predictions to actual occurrences of the event of interest, and low‐probability predictions to nonoccurrences of the event of interest. Unlike existing methods for assessing predictive power for logit and probit models such as Percent Correctly Predicted statistics, Brier scores, and the ROC plot, our “separation plot” has the advantage of producing a visual display that is informative and easy to explain to a general audience, while also remaining insensitive to the often arbitrary probability thresholds that are used to distinguish between predicted events and nonevents. We demonstrate the effectiveness of this technique in building predictive models in a number of different areas of political research.
17
Ethnicity, Insurgency, and Civil War
James D. Fearon, David D. Laitin · American Political Science Review · 2003 · 6.1K citations
VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
Glenn W. Brier · Monthly Weather Review · 1950 · 5.3K citations
Business, Mathematics, Meteorology +10