Moving beyond a National Habit in the Call for Accountability

Peggy L. Maki

2009 · 10 citations · 0 references

Concepts

Abstract

During and after the heated exchanges that led to the 2008 Higher Education Act, standardized tests were, not surprisingly, proposed as the first response to document college and university for student learning. Policy makers and decision makers were especially responsive to this effort, believing they then could efficiently compare institutions and fill out the report card for state-by-state educational performance based on a sample of students' performance on national instruments. Efficient discussions about student scores could, in turn, spawn state and federal policies. With some exceptions, tests - aptitude, achievement, placement, certification, entry-level, for example - have dotted our educational and professional lives from the moment we entered formal education. Let's face it: testing is a national, even international, habit - a first-response solution to questions about student achievement - because it enables quick and efficient judgments, including policy makers' decisions. DEMONSTRATING STUDENT LEARNING THROUGH STANDARDIZED TESTS Some institutions immediately chose to conform to the firstresponse solution - maybe even to remove the issue as a central institutional concern - using existing standardized instruments to demonstrate their students' general education learning, i.e. the Collegiate Assessment of Academic Proficiency (CAAP), the Measure of Academic Proficiency and Progress (MAPP), or the Collegiate Learning Assessment (CLA), a newer standardized test that takes a performance-based approach in its critical and analytical thinking and writing instruments. (Though the developer of the CLA did not originally develop its tests to be used as national instruments to compare institutions' performance, but as instruments an institution could use along with other sources of student learning evidence to take stock of its students' learning, nonetheless, the CLA sought to become the national gold standard to compare institutions' educational quality.) Among higher education organizations, the Association of Public Land-Grant Universities (APLU), formerly the National Association of State Universities and Land-Grant Colleges (NASULGC), and the American Association of State Colleges and Universities (AASCU) proposed that its member institutions voluntarily post scores from students' performance on either the MAPP, CAAP, or CLA under its Voluntary System of Accountability (VSA). These scores are included in VSA's College Portrait of Undergraduate Education Web site as one of the informational components about its institutions. These components are presented in a way that assists parents and prospective students to learn more about institutions they are considering (www.collegeportraits.org/guide.aspx). Although the site offers institutions the option to post other student achievement information, the College Portrait site is designed for comparisons among its schools. Thus, for example, data that lend themselves to numerical representation are presented - retention rates, graduation rates, results of student surveys, and now standardized tests scores for students' general education learning as a primary indicator of educational effectiveness. Measured at the institution level only, average test scores of seniors (for example, CLA recommends sampling one hundred freshmen and one hundred seniors for four-year institutions) are compared with those of freshmen to represent students' learning gains at an institution. A score of sample students' achievement is becoming, then, a way to brand institutions' educational effectiveness as well as a way to compare institutions. In defense of the current use of standardized tests among institutions participating in the VSA, David E. Shulenburger, vice president for academic affairs at APLU, argues that use of an outcomes test creates a rough comparability among participating universities and enhances public accountability (Lederman 2009). …