2025 · 12 citations · 111 references
Public HealthBiostatisticsCausal InferenceExperimental DesignMeta-analysisData ExtractionEffect Size EstimationPower AnalysisEffect SizeEffect Size AnalysisEffect Size ExtractionEffect Size InterpretationPower Curves
Statistical reporting, especially of effect sizes, is at the root of many methodological issues in quantitative research at CHI. Effect sizes are necessary for assessing practical relevance of results, a-priori power analysis, and meta-analyses, but currently, they are often not reported. Interpretations in the context of the study and the research field are also rare. To aid to researchers in reporting and contextualizing their effect sizes within their research field as well as choosing effect sizes for power analysis, we conducted a meta-study of quantitative CHI papers. We extracted statistics from all quantitative CHI papers published between 2019-2023 (N=1692). Based on effect sizes and the papers' CCS categories, we present effect size distributions in 12 CHI research fields. Through an additional qualitative analysis of 67 quantitative CHI'23 publications, we identify five categories of approaches that researchers take when interpreting effect size: Comparing test-specific values, assigning size labels, using a statistical or methodological reference frame, comparing different observations and interpreting for the big picture.
111
R: A Language and Environment for Statistical Computing
R Core Team · 2000 · 353K citations · Full text
Natural Sciences, Computer Science, Statistical Computing +10
Hadley Wickham, Mara Averick, Jennifer Bryan et al. · The Journal of Open Source Software · 2019 · 21.6K citations · Full text
Advances in Neural Information Processing Systems 29
Onur Teymur, Kostas Zygalakis, Ben Calderhead · 2016 · 13.5K citations
F. N. David, John W. Tukey · Biometrics · 1977 · 12.9K citations