A great, slightly more in depth (without being mathy) explanation of transformer models. Mostly talking about AlexNet, an image classifier from 2012. Goes over some history and has some very interesting looks under the hood.
He does use some personifying language for these models, but that's unfortunately the case for most information on the topic.
Honestly the video made it sound like CNNs were a part of transformers, so I'd blame the video before yourself