Concepedia

Benchmark Bias

Benchmark Bias is a methodological artifact in empirical research that systematically distorts performance evaluations of academic contributions by favoring certain models, methods, or theories due to non-representative, skewed, or unrepresentative selection of benchmark datasets, tasks, or metrics.

36

Publications

2.1K

Citations

123

Authors

96

Institutions

Publications per year

2017–2026

19

Variants

Benchmarking Bias

Parents

Publications

36

Should Benchmark Indices Have Alpha? Revisiting Performance Evaluation

Martijn Cremers · Critical Finance Review · 2013 · 260 citations

, , +17

Can the Counterpoise Correction for Basis Set Superposition Effect Be Justified?

Ł. M. Mentel, Evert Jan Baerends · Journal of Chemical Theory and Computation · 2013 · 191 citations

, , +10

Should Benchmark Indices Have Alpha? Revisiting Performance Evaluation

Martijn Cremers, Antti Petäjistö, Eric Zitzewitz · SSRN Electronic Journal · 2010 · 141 citations · Full text

, , +17

BBQ: A hand-built bias benchmark for question answering

Alicia Parrish, Angelica Chen, Nikita Nangia et al. · Findings of the Association for Computational Linguistics: ACL 2022 · 2022 · 140 citations · Full text

, , +14

Should Benchmark Indices Have Alpha? Revisiting Performance Evaluation

Martijn Cremers, Antti Petäjistö, Eric Zitzewitz · National Bureau of Economic Research · 2012 · 105 citations · Full text

, , +17

1–5 of 36

Authors

123

  1. MC
    Martijn Cremers

    University of Notre Dame, United States

    3 publications · 506 citations

    3

    h-index

  2. MT
    Marlon T. Conato

    University of the Philippines Diliman, Philippines

    2 publications · 108 citations

    2

    h-index

  3. JD
    Jeffrey D. Rimer

    University of Houston, United States

    2 publications · 108 citations

    2

    h-index

  4. MH
    Ming‐Feng Hsieh

    University of California, Santa Barbara, United States

    2 publications · 108 citations

    2

    h-index

  5. MD
    Matthew D. Oleksiak

    University of Houston, United States

    2 publications · 108 citations

    2

    h-index

1–5 of 123

Institutions

96

  1. New York University

    New York, United States

    3 h-index

    12 publications

    1.6K citations

  2. Waseda University

    Tokyo, Japan

    2 h-index

    2 publications

    108 citations

  3. The University of Tokyo

    Tokyo, Japan

    2 h-index

    6 publications

    324 citations

  4. University of Notre Dame

    Notre Dame, United States

    2 h-index

    2 publications

    401 citations

  5. University of Houston

    Houston, United States

    2 h-index

    8 publications

    432 citations

  6. Yale University

    New Haven, United States

    2 h-index

    4 publications

    456 citations

  7. European Corporate Governance Institute

    Brussels, Belgium

    2 h-index

    2 publications

    170 citations

  8. University of the Philippines Diliman

    Quezon City, Philippines

    2 h-index

    2 publications

    108 citations

1–8 of 96

Venues

  1. SSRN Electronic Journal

    Repository · 4 publications · 213 citations

    4

    h-index

  2. arXiv (Cornell University)

    Repository · 3 publications · 133 citations

    3

    h-index

  3. Journal of Chemical Theory and Computation

    JCTC · 1 publications · 191 citations

    1

    h-index

  4. Corporate Governance

    1 publications · 16 citations

    1

    h-index

  5. Forest Science

    1 publications · 15 citations

    1

    h-index

1–5