Matt Barnum:

The study comes with a few important caveats.
The spike in test-score growth toward the end of the five-year grant coincided with the introduction of a new test aligned with the Common Core, the PARCC. It also coincided with an increase in students opting out of state tests, both in Newark and statewide. The researchers try to account for this, but it’s not entirely clear if those changes skewed the findings.

Also, the researchers came to their conclusions by comparing test score growth of Newark’s students to students with similar backgrounds and in similar schools across New Jersey. That doesn’t guarantee that the study is able to isolate the effects of the reforms, but does allow for comparisons to places without the Zuckerberg money or attention.

The results don’t show whether the reforms “worked” — because that’s a complicated question.
The study is focused on standardized test scores, a significant limitation that means it doesn’t speak to other effects of the reforms on students. A separate analysis, funded by the Community Foundation of New Jersey and also released Monday, points out that high school graduation rates in Newark rose substantially in 2016 and 2017, after remaining flat between 2012 and 2015. Enrollment in the city schools has also trended upward in recent years.

Source: “Moving Up: Progress in Newark’s Schools from 2010 to 2017”
The results also don’t account for political turmoil or the sense that the reforms were done to — rather than with — the community in Newark, whose schools had been under state control for a over two decades. An agreement was finalized in September to return them to community control.

“Ultimately we’re giving the parents the opportunity to have their democratic rights back,” Baraka told NPR, who argued in the same interview that the Zuckerberg dollars had not improved the school district. “There is no real kind of causal relationship between that money and the development of the traditional public schools in Newark.”

Locally, we have spent far more than most government funded school districts (now nearly $20,000 per student), yet we’ve long tolerated disastrous reading results. Yet, Madison’s non diverse governance model continues unabated, aborting the proposed Madison Preparatory IB Charter school and more recently a quasi Montessori charter proposal.