Christopher Martell:

This is not a post about what standardized tests do. The reality is that educational assessment is a complicated process. High-quality standardized tests can be helpful in assessing what students know, but they do not always measure what they intend to measure. More importantly, they are also only one of many assessments that teachers and schools use to get a fuller picture of what students understand and are able to do (see here for an argument on why standardized tests are problematic and evidence that students already take too many of them). 

Rather, this is a post about what standardized tests can’t do. Standardized tests were never designed (and should never be used) to determine if a student should receive a high school diploma. As an educational researcher, I know a little about this. I remember my quantitative research methods professors as a doctoral student always telling us that “a test only measures what a test measures.” So, you should never try to use that test to measure something it was not designed to do. The Massachusetts Comprehensive Assessment System (MCAS) was designed to measure one thing: basic comprehension in literacy, mathematics, and science. Students may be not only proficient, but advanced in other academic areas, such as history/social studies, world languages, art, music, theater, consumer and family sciences, computer science, vocational fields, or business, but if they do not reach an arbitrary MCAS score in only three subject area tests, they will not receive a diploma in Massachusetts.

The MCAS does not measure workforce or higher education readiness. The MCAS does not measure a student’s ability to think critically or problem solve. The MCAS does not improve student’s individual economic opportunity (but a student’s economic opportunity can predict their MCAS score). The opponents of Question 2 will tell you an MCAS graduation requirement is necessary for all of these things to occur; they are being intentionally disingenuous (in fact many boldly claim that this ballot question will get rid of MCAS altogether, which it does not). Moreover, researchers have long known that social class may influence up to 84% of a student’s MCAS score. In many ways, the MCAS tells us more about how much wealth a student’s family or community has than it measures the quality of that student’s schools or their individual learning.