Psychological Bulletin · 1989 · 753 citations · 44 references
Public HealthBiostatisticsExperimental DesignResearch EthicsStatisticsHypothesis TestingInferential StatisticsPower AnalysisStatistical AnalysisStatistical InferenceStudy DesignEffect Size AnalysisPower CurvesStatistical PowerStatistical Power AnalysisStatistical Power Estimation
The long‑term impact of studies of statistical power has been examined using J. Cohen’s 1962 work as a case study. The study investigates whether research on statistical power influences subsequent study power, using Cohen’s 1962 work as a case study.
The long-term impact of studies of statistical power is investigated using J. Cohen's (1962) pioneering work as an example. We argue that the impact is nil; the power of studies in the same journal that Cohen reviewed (now the Journal of Abnormal Psychology) has not increased over the past 24 years. In 1960 the median power (i.e., the probability that a significant result will be obtained if there is a true effect) was .46 for a medium size effect, whereas in 1984 it was only .37. The decline of power is a result of alpha-adjusted procedures. Low power seems to go unnoticed: only 2 out of 64 experiments mentioned power, and it was never estimated. Nonsignificance was generally interpreted as confirmation of the null hypothesis (if this was the research hypothesis), although the median power was as low as .25 in these cases. We discuss reasons for the ongoing neglect of power.
44
Belief in the law of small numbers.
Amos Tversky, Daniel Kahneman · Psychological Bulletin · 1971 · 3.3K citations