http://www.greatlakescenter.org
http://www.greatlakescenter.org
State School Performance Report Card Gets an 'F' Reviewers find Heartland analysis flawed, biased and of little value Contact: Teri Battaglieri, Great Lakes Center for Education Research and Practice EAST LANSING, Mi. (December 14, 2010) –The Heartland Institute's 2010 State School Report Card: A state-by-state analysis of learning, efficiency, and standards, purports to rank states on student achievement, education expenditures and adherence to learning standards. In a review of that report released today, Edward Fierros and Bridget Ann Rooney of Villanova University find that it cites limited, partisan research, provides no rationale to support its methods and fails to control for underlying variations from state to state in demographics and other characteristics. The review, part of the Think Twice think tank review project, was produced by the National Education Policy Center (NEPC), housed at the University of Colorado at Boulder with funding from the Great Lakes Center for Education Research and Practice. The Heartland report ranks the 50 states and the District of Columbia according to four indices: (1) gains or losses in National Assessment of Education Progress math and reading test scores from 2005 to 2009; (2) an "index of outcomes" that calculates costs per graduate, per student, per "learning gain over time" and "per unit of learning between grades," and the ratio of teachers to staff – all in the name of measuring "efficiency"; (3) "standards" – which combines a ranking concerning states' inflation of proficiency claims and rankings (grades) assigned to each state by the Fordham Institute on the "rigor and content" of math, reading and science standards; and (4) a composite score derived from each state's first three indices. Fierros and Rooney explain that all three of the core indices are flawed – two of them seriously so. They note, for instance, that the report's system of assigning letter grades based on the rankings is problematic because it forces roughly the same number of states into each letter grade category. This approach "guarantees that there will be failing states even though the numerical differences between the states are often not very large." While many states have nearly identical scores, the methods used to calculate their final rank exaggerates their differences. The Heartland report calls for expanded school choice options and the adoption of "Parent Trigger laws" whereby parents whose children attend a "failing" school can force a charter school or other conversion. According to Fierros and Rooney, these recommendations aren't based on the report card calculations, "but rather on several brief and uncritical references to past think tank reports." At the same time they note the report ignores research literature that finds little or no benefit from such policy prescriptions. While a study using national data to examine states' education performance has the potential for sparking "a deep and careful examination" of what might account for differences in school performance among states, the Heartland Report Card is not that study, Fierros and Rooney conclude. Its methods skew state-level education outcomes, its analyses are simplistic and it lacks evidence to support its advocacy for school choice policies as a remedy. "For these reasons," Fierros and Rooney conclude, "the report is not useful in guiding policy or practice." Find Edward Fierros's review on the Great Lakes Center website at: Find 2010 State School Report Card: A state-by-state analysis of learning, efficiency, and standards, by Herbert J. Walberg and Marc Oestreich, on the web at: The Think Twice think tank review project, a project of the National Education Policy Center, provides the public, policy makers and the press with timely, academically sound reviews of selected think tank publications. The project is made possible in part by the generous support of the Great Lakes Center for Education Research and Practice. The review is also available on the National Education Policy Center website at: ### |
The mission of the Great Lakes Center is to improve public education for all students in the Great Lakes region through the support and dissemination of high quality, academically sound research on education policy and practices. Visit the Great Lakes Center Web Site at: http://www.greatlakescenter.org |