“State’s fictional test score gains”

Dale Chu:

The assessment world was set alight last week with the news of skyrocketing test gains in the Sooner State. Reading scores for Oklahoma’s third graders jumped from 29 percent proficient last year to 51 percent this year. Eighth graders bested their previous mark by double, spiking from 20 percent proficiency to 40 percent. While some welcomed the ostensibly good news, Harvard’s Andrew Ho described the gains as “nonsensical fiction.”

Which indeed they were. Rather than reflecting an actual improvement in student performance, the astronomical increases resulted from a lowering of the threshold required (i.e., adjusting the cut scores) to achieve proficiency. Had the scoring system not been changed, the results would have been similar or slightly below the previous year’s. To put things in context, the new cut scores are closer to the “NAEP Basic” mark, while the previous cut scores were on the cusp of “NAEP Proficient.” This is worth nothing because once upon a time, Oklahoma was among the leaders of the pack (see graph below) in benchmarking proficiency to the higher standard:

——

Wisconsin DPI’s ongoing rigor reduction and mulligan campaign.