Psychological Methods · 1996 · 213 citations · 36 references
Natural SciencesBiostatisticsExperimental DesignStatisticsHypothesis FormulationHypothesis TestingInferential StatisticsStatistical AnalysisStatistical InferenceStatistical SignificanceMultiple Hypothesis TestingNull HypothesisNull Hypothesis FormulationStatistical Significance TestingStatistical Testing
The many criticisms of null hypothesis testing suggest when it is not useful and what is should not be used for. This article explores when and why its use is appropriate. Null hypothesis testing is insufficient when size of effect is important, but it is ideal for testing ordinal claims relating the order of conditions, which are common in psychology. Null hypothesis testing also is insufficient for determining beliefs, but it is ideal for demonstrating sufficient evidential strength to support an ordinal claim, with sufficient evidence being 1 criterion for a finding entering the corpus of legitimate findings in psychology. The line between sufficient and insufficient evidence is currently set at p < .05; there is little reason for allowing experimenters to select their own value of alpha. Thus null hypothesis testing is an optimal method for demonstrating sufficient evidence for an ordinal claim.
36
The earth is round (p < .05).
Jacob Cohen · American Psychologist · 1994 · 3.9K citations
Meta-analysis in social research
Evaluation and Program Planning · 1982 · 3.9K citations