The original chat bot guy, Joseph Weizenbaum, the guy who made Eliza, wrote a book basically about how he was surprised how people personified these things and how its a danger to the world (Computer Power and Human Reason: From Judgment To Calculation). Good book, highly recommend.
Teacher’s expectations will likely go up in response, fully leaving any honest student behind.