Measuring Learning Outcomes in Higher Education

TLDR

Standardized outcomes assessments are widely used in higher education to evaluate learning and inform policy amid accountability demands. The study aims to examine how students’ motivation influences assessment scores. Students were randomly assigned to one of three motivational conditions, completed a multiple‑choice test and an essay, and reported their motivation levels. Results show that motivation strongly predicts test scores, creating a large performance gap (effect size up to .68) and causing college learning‑gain estimates to range from substantial positive (d = 0.72) to negative (d = −0.23), underscoring significant implications for stakeholders.

Abstract

With the pressing need for accountability in higher education, standardized outcomes assessments have been widely used to evaluate learning and inform policy. However, the critical question on how scores are influenced by students’ motivation has been insufficiently addressed. Using random assignment, we administered a multiple-choice test and an essay across three motivational conditions. Students’ self-report motivation was also collected. Motivation significantly predicted test scores. A substantial performance gap emerged between students in different motivational conditions (effect size as large as .68). Depending on the test format and condition, conclusions about college learning gain (i.e., value added) varied dramatically from substantial gain ( d = 0.72) to negative gain ( d = −0.23). The findings have significant implications for higher education stakeholders at many levels.