Statistics Politics and Policy · 2015 · 17 citations · 31 references
Natural SciencesPolitical ScienceCausal InferenceEconometricsStatisticsConfidence IntervalsEffect Size EstimationHypothesis TestingStatistical AnalysisStatistical InferenceStatistical SignificanceConfidence Interval ConstructionConfidence Interval EstimationConfidence Interval EvaluationConfidence Interval InterpretationInterpreting Statistical InformationPoint EstimateStatistical Significance Testing
Abstract Political science is gradually moving away from an exclusive focus on statistical significance and toward an emphasis on the magnitude and importance of effects. While we welcome this change, we argue that the current practice of “magnitude-and-significance,” in which researchers only interpret the magnitude of a statistically significant point estimate, barely improves the much-maligned “sign-and-significance” approach, in which researchers focus only on the statistical significance of an estimate. This exclusive focus on the point estimate hides the uncertainty behind a veil of statistical significance. Instead, we encourage researchers to explicitly account for uncertainty by interpreting the range of values contained in the confidence interval. Especially when making judgments about the importance of estimated effects, we advise researchers to make empirical claims if and only if those claims hold for the entire confidence interval.
31
Jacob Cohen · Psychological Bulletin · 1992 · 42.2K citations
Joseph P. Simmons, Leif D. Nelson, Uri Simonsohn · Psychological Science · 2011 · 6.7K citations
Primary, Secondary, and Meta-Analysis of Research
Gene V. Glass · Educational Researcher · 1976 · 4.7K citations
John W. Tukey · The Annals of Mathematical Statistics · 1962 · 1.9K citations · Full text