I can imagine so many incredible ideas being shit canned simply because the ai has never seen it before
I think this is overrating the extent to which a LLM can even really read.
The TEA is right about one thing: calling early 21st century machine learning systems "AI" is letting the marketers win. The scoring system is not an "intelligence" in the sense most people would understand the term to mean.
Man I love the word horseshit in human conversation. No horseshit.
From the very beginning of this LLM craze, they've been talking about replacing teachers with it. I suspect they're going to ham slice their way into education one precedent at a time until every child gets their entire education through an iPad that talks at them with the Microsoft Sam voice (unless you're rich, elite private schools won't go anywhere near this stuff).