In 1997, American Airlines captain Warren VanderBurgh gave a lecture warning about the dangers of autopilot. He titled it “children of the magenta line,” after the magenta coloured course line the flight computer draws across a cockpit display. He noticed that pilots were so used to following that line, to managing the automation rather than actually flying the plane, that they lost their own skills to manually fly the plane. This wasn’t a problem until it was a problem.
VanderBurgh’s concern was not about autopilot itself but rather the complete dependency on autopilot at the expense of the internal knowledge of how it works and the loss of the judgment to know when to use it. In 2009, his warning came true in the very worst way possible over the Atlantic. When Air France 447’s sensors iced over, the autopilot handed a perfectly good airliner back to its crew, the pilots, confused and out of practice, stalled it into the
sea.

The thing I find really fascinating about this story and why I think it has so much import for learning and AI is that his core diagnosis was that the autopilot was in fact, not the problem. The truth is that automated function in planes saves far more lives than it endangers and I think the same will be true of self-driving cars. (I have no interest in the hackneyed claim that the machines are bad and the humans good. The machines are, on the whole, magnificent I think). The thing I think is so interesting is that when faced with an emergency, the pilots reached instinctively for more automation not less, when the right thing to do was often to drop down a level and fly. So the danger is not automation itself but over-dependency on automation and this is quite obviously what happens when we give novice learners unfettered access to chatbots.
But actually its worse than that because those pilots had already internalised lots of organised knowledge. What is happening now for many students is worse because they dont even know what they dont know. To understand why this is the case, we need to go back and look at some misguided ideas about learning.
One of the dominant concepts of learning since the 1970s has been the idea that facts and internalised knowledge is the lowest rung on the ladder of learning, the part we can safely externalise, because you can always look it up (see Bloom’s taxonomy). Teach the transferable skills, ie the critical thinking, the questioning, the analysing, and let the facts take care of themselves; after all, they are only a search away, and half of them will be out of date within five years in any case. It is a seductive picture, and it is almost exactly wrong. In fact, in the words of Wolfgang Pauli, it’s not even wrong.
——-
2026-2027 Madison K-12 $pending continues to grow, fueled by a 9.7% (!) property tax increase. Total spending will be at least $706,000,000 for 25,003 students, or $28,236 per student.
May 2026 Madison School District Presentation: 7,095 adults for 25,003 students (3.52 students per adult!)
Early Literacy Screener Map.
Map: Foundations of Reading Results: 2015–2024
Where have all the students gone?
3,887 Madison 4 year old to third grade students scored lower than 75% of the students in the national comparison group.
Madison taxpayers have long supported far above average k-12 tax & $pending. This despite our long term, disastrous reading results. May, 2026: 7,095 Staff for 25,003 students; $pending > $26k per student!
Madison Schools: More $, No Accountability
The taxpayer funded Madison School District long used Reading Recovery…
The data clearly indicate that being able to read is not a requirement for graduation at (Madison) East, especially if you are black or Hispanic”
A.B.T.: “Ain’t been taught.”
My Question to Wisconsin Governor Tony Evers on Teacher Mulligans and our Disastrous Reading Results
2017: West High Reading Interventionist Teacher’s Remarks to the School Board on Madison’s Disastrous Reading Results
Madison’s taxpayer supported K-12 school district, despite spending far more than most, has long tolerated disastrous reading results.
“An emphasis on adult employment”
Wisconsin Public Policy Forum Madison School District Report[PDF]
WEAC: $1.57 million for Four Wisconsin Senators
Friday Afternoon Veto: Governor Evers Rejects AB446/SB454; an effort to address our long term, disastrous reading results
Booked, but can’t read (Madison): functional literacy, National citizenship and the new face of Dred Scott in the age of mass incarceration.
When A Stands for Average: Students at the UW-Madison School of Education Receive Sky-High Grades. How Smart is That?

