Martin Carnoy and Richard Rothstein:

Earlier this year, we published an analysis of international test score data in which we showed that these data hide many complex issues, and that glib conclusions regarding the meaning and policy implications of international test data should be avoided. We showed that it is more appropriate to compare student performance across countries by comparing students with similar social class backgrounds, and we showed that comparative information is more useful if it includes test data trends over time as well as levels in the current year. We also presented apparent anomalies in test data (for example, periods in which performance on one international test goes up but performance on another international test, purporting to measure the same subject, goes down, or carelessness in sampling methodology) that should caution analysts from relying too heavily on test score data.
Upon the release of our report, we were attacked by several promoters of the conventional idea that international test data show that American schools are in collapse and are threatening our economic security. Prominent among these was Marc Tucker, president of one of the leading education-scold organizations, the National Center on Education and the Economy. Tucker attacked our report without having bothered to read it, and was subsequently forced to issue an apology for misrepresenting our findings (“We misstated the conclusions presented by Martin Carnoy and Richard Rothstein in the report described in this newsletter. We believe we have stated those conclusions accurately here, and apologize to the authors for the error.”).

Related: www.wisconsin2.org