At Fireside, you can share what's on your mind about education.
Noted that several people on Fireside seemed delighted by Michigan Professor Gary Miron's attacks on KIPP. Having been on a panel with Miron, I can report that he regards the charter movement as a "distraction." He is hardly a neutral observer (neither am I).
But I know several of you share his views that the real problem with students is too many poor people - and that schools can't overcome this.
You may want to read the response from KIPP to Miron's assertions (Below) - although given the deep ideological, quasi religious belief that some have about poverty and students, Kipp's response won't make much difference for some.
There certainly is evidence that poverty has a huge impact, and makes progress for some students more difficult. There also is evidence that a number of district and charter schools have been able to overcome the impact of poverty.
I realize ignoring this research makes it easier for educators to justify failure. I've been hearing about this for literally 40 years. How sad for the students.
Joe Nathan, former inner city public school teacher & administrator & PTA president
Statement by KIPP regarding report: “What Makes KIPP Work?” by Dr. Gary Miron and colleagues at Western Michigan University
March 30, 2010
At KIPP, we welcome any rigorous and objective review of our schools. We have participated on several occasions with outside, independent reviews, such as the 2010 study by Mathematica Policy Research.
Today we received a copy of the report “What Makes KIPP Work? A Study of Student Characteristics, Attrition and School Finance,” by Dr. Gary Miron, Jessica L. Urschel, and Nicholas Saxton at Western Michigan University (WMU). In our quick read of the WMU report we observe significant shortcomings in the methodologies used, and must therefore reject the core conclusions made by Miron, et al. about KIPP.
While this report focuses on some very fundamental issues for KIPP—student enrollment, attrition, and finances—its findings do not hold up to scrutiny. We have identified, based on our quick review of the report, multiple factual misrepresentations and errors of analysis, which we would like to address.
For example, the WMU report claims that KIPP received $5,760 per student in private funding for the 2008 fiscal year. However, this result is based on an analysis of only half of our schools, and includes at least two instances where private revenue for regions was misclassified -- including not distinguishing between funds for operating versus capital expenses. When we look at correctly classified data for these two KIPP regions, and include all KIPP schools that were in operation that year, the number drops to approximately $2,500 per student.
We have included a fact sheet with a closer examination of inaccuracies the WMU report’s data and methodology. Given the limited time we have had to review the document, we are not assuming that this is by any means a comprehensive review.
Fact Sheet: A Closer Look at the Data: “What Makes KIPP Work?
In the March 2011 report “What Makes KIPP Work? A Study of Student Characteristics, Attrition and School Finance,” Dr. Gary Miron and his colleagues at Western Michigan University raise some important questions about KIPP schools. These three questions are ones that we take seriously and have studied over time.
Taken collectively, the WMU report suggests that the progress made by KIPP schools is fundamentally dependent on selective admission of students, high levels of attrition, and private funding that supports significantly higher rates of spending than in traditional district schools. We reject these assertions.
What follows is a closer look at the fact base around these issues:
Fact 1 – KIPP schools on average have higher concentrations of low income and minority students, and lower concentrations of special education and LEP students. We do not attract the most able students.
KIPP schools are open-enrollment public schools, and do not use selective criteria for admission. The findings regarding student demographics in the WMU study are generally consistent with those in the Mathematica report, which concludes that “KIPP schools have student bodies characterized by higher concentrations of poverty and racial minorities and lower concentrations of special education and LEP students.”
What the WMU study does not address, however, is the considerable evidence that KIPP is not promoting selective entry, or “creaming” students. In fact, our students most often come to us with lower academic achievement levels than their peers. The Mathematica report concluded that “KIPP middle schools enroll students whose entering fourth grade achievement is lower than the district-wide average” and comparable to the average for neighborhood feeder elementary schools.
Fact 2 – KIPP schools do not have systematically higher (or lower) levels of attrition as compared to schools within their districts. KIPP student achievement gains cannot be explained by student attrition or selective entry.
The WMU report claims that KIPP schools have significantly higher levels of student attrition than neighboring school districts. The researchers arrived at this conclusion by comparing annual school-level enrollment data for KIPP schools to total school district-level enrollment over a three-year period.
The WMU report relies on an apples-to-oranges comparison, as the district attrition figures do not take into account students who transfer from school to school within a district.
In addition, the WMU report overstates KIPP’s enrollment decline due to incorrect data. For example, WMU reports that KIPP Academy of Opportunity in Los Angeles served 2 eighth grade students in 2008-09, when it actually served 64 eighth graders (see Appendix A, page 4).
A more rigorous analysis of student attrition is provided by Mathematica’s 2010 report. It uses student-level data and compared student attrition at KIPP schools to individual schools in neighboring districts with similar demographics across thirteen communities. In addition, Mathematica’s report found that KIPP’s achievement gains cannot be explained by student attrition. Even when explicitly accounting for student attrition, they found that KIPP’s “impacts on students’ state assessment scores in mathematics and reading are positive, statistically significant, and educationally substantial.”
Fact 3 – KIPP schools received far less than $5,760 in private revenue per pupil in fiscal year 2008 for operating expenses.
WMU claims that KIPP has a “$6,500 advantage” per student over neighboring district schools in fiscal year 2008—due in large part to their asserting that KIPP receives $5,760 in additional private funding per pupil. WMU’s private funding number is inflated for several reasons: the report uses a selective sample of our schools, misunderstands how KIPP schools use private funding (i.e., does not distinguish between operating and capital expenses), and contains incorrect data points.
First, WMU creates a non-representative sample of schools that leads to the overstatement of KIPP’s private revenue per pupil.
To get to the $5,760 per pupil in private funding at KIPP, WMU used a sample of 28 of the 58 KIPP schools that operated during 2007-08 (Table 1, page 21). This is roughly half of the schools in operation that school year and for which WMU collected data (see Appendix D). This sample of 28 schools included 71 percent of the network’s private revenue but only 45 percent of students served in 2007-08. If they had used the full sample size of KIPP schools operating in 2007-08, WMU would have calculated per pupil private revenue of $3,715—which is $2,000 less per pupil than their estimate.
Second, the report fails to acknowledge that KIPP and others turn to private funding to compensate for the inequities in public funding on several fronts – capital expenses, start-up costs and general operating costs.
Whereas districts receive taxpayer bond money to fund facilities and other capital projects, KIPP schools that are denied access to public facilities must look to private funding to match the bond proceeds received by districts. Furthermore, private funding supports start-up costs which are only incurred in a school’s early years. Of the 58 KIPP schools operating in 2007-08, 24 of the schools were in their first, second or third year of operation during the year examined and had not yet reached full enrollment. KIPP schools grow one grade level at a time, requiring them to fund an administrative staff on the public funding associated with a partially enrolled school, which makes the private funding need higher in the earlier years; as a school grows to full enrollment, the need for private funding diminishes. Lastly, in addition to capital expenses and start-up expenses, studies have demonstrated that charters receive less public funding for general operating expenses.
Finally, at least two of the private revenue figures used in the analysis are incorrectly classified (see page 21).
For example, of the $17.3 million in private revenue reported by KIPP Houston in 2007-08, more than $10 million was restricted for purchasing land and building or renovating schools, not general operating expenses. In addition, the stated figure of $8.1 million private revenue for KIPP schools in Newark, NJ (TEAM Academy) is the result of a misclassification on the 990 form. Team Academy’s audited financials for that year report $1.5 million in private revenue; the remaining revenue was actually state and local public revenue and, therefore, was double counted in the WMU analysis. When adjusting KIPP’s overall private revenue per pupil for just these two material corrections with KIPP Houston and KIPP Newark schools, the average revenue for KIPP schools in fiscal year 2008 decreases to approximately $2,500.