REVIEW OF EVALUATION STUDIES OF MATHEMATICS AND SCIENCE CURRICULA AND PROFESSIONAL DEVELOPMENT MODELS

Abstract

This report identifies mathematics and science curricula as well as professional development models at the middle and high school levels that are effective based on their success in increasing student achievement. The goal of the study was to provide some choice to districts and schools that wanted guidance in selecting a curriculum and that wished to use effectiveness as a selection criterion. Unexpectedly, most middle and high school mathematics and science curricula did not have studies of student achievement with comparison groups, and it proved especially difficult to find effects in either math or science for subgroups by sex, minority status, and urban status. Findings strongly suggest that science curricula is more effective when it is inquiry-based, although math curricula can be effective when standardsor traditional-based. REVIEW OF EVALUATION STUDIES OF MATHEMATICS AND SCIENCE CURRICULA AND PROFESSIONAL DEVELOPMENT MODELS By Beatriz C. Clewell Clemencia Cosentino de Cohen The Urban Institute and Patricia B. Campbell Lesley Perlman Campbell-Kibler Associates, Inc. with Nicole Deterding Sarah Manes Lisa Tsui The Urban Institute and Shay N.S. Rao Becky Branting Lesli Hoey Rosa Carson Campbell-Kibler Associates, Inc. Submitted to the GE Foundation December 2004 Acknowledgments A number of individuals contributed to this effort in various ways. We were fortunate to have the assistance of Gerhard Salinger of the National Science Foundation; Jo Ellen Roseman of Project 2061 at the American Association for the Advancement of Science (AAAS); Joan Abdallah at AAAS; and several staff members at the Center for Science Education at the Education Development Center—Barbara Berns, Jeanne Century, Joe Flynn, Elisabeth Hiles, Jackie Miller, Marian Pasquale, and Judith Sandler —in helping us identify science curricula that might have evaluation studies. We are also deeply indebted to those who reviewed our report and offered useful suggestions for revising it: Jane Butler Kahle at Miami University of Ohio and Linda Rosen of Education & Management Innovations, Inc. Thanks are due to William Bradbury and Cara West, Urban Institute staff who helped in the production of the report. Most of all, we wish to express our appreciation for the responsiveness of curriculum developers and researchers whose curricula are reviewed in this report and who shared evaluation studies with us. Last, but not least, we thank our program officer, Roger Nozaki and his colleague, Kelli Wells, both of the GE Foundation, for their insightful comments and suggestions on the report draft that helped to make this document more user-friendly. We thank the GE Foundation for funding this review and for taking an evidence-based approach to school reform. We think it’s the only way to go. REVIEW OF EVALUATION STUDIES OF MATHEMATICS AND SCIENCE CURRICULA AND PROFESSIONAL DEVELOPMENT MODELS Introduction This report presents the findings of a review of about four hundred studies evaluating mathematics and science curricula and professional development models for middle school and high school. As requested by the GE Foundation, the main goal of this review was to identify, in response to the GE Foundation’s request, mathematics and science curricula as well as professional development models that had been deemed effective based on their success in increasing student achievement. The Foundation’s interest in these findings stems from its desire to initiate a program of funding to foster sustainable improvement in academic achievement of underrepresented and disadvantaged populations. Historically, curriculum choice at the local level has often been made by a committee that decides which curriculum to adopt based on considerations only peripherally related to student achievement—such as state-imposed standards, recommendations of others, cost, and presentations by publishers’ representatives. Choice of professional development models follows a similar pattern. Indeed, there has been very little else available to guide school districts in their curriculum selection process, since for most curricula and textbooks the only data at hand are publishers’ figures on the number of adoptions. That has been changing. There is a growing movement to assess the effectiveness of math and science curricula through various methodologies, including content analyses, comparative studies, case studies, and synthesis studies. And while there have been several studies of the effectiveness of professional development practices, very few have measured the effects of these practices on student achievement. In this document, we describe the methodology used to conduct this review, present our findings, and end with a summary of conclusions. To provide an international perspective on these topics, the report includes a brief look at the research on mathematics and science education in three countries that are similar in key dimensions to the U.S.