A great, slightly more in depth (without being mathy) explanation of transformer models. Mostly talking about AlexNet, an image classifier from 2012. Goes over some history and has some very interesting looks under the hood.
He does use some personifying language for these models, but that's unfortunately the case for most information on the topic.
This is mostly about convolution neural networks, which don't really work the same way as transformers. transformers weren't invented until 2017 and they are most like a more complex version of a recurrent neural network (even that is simplifying it)
Honestly the video made it sound like CNNs were a part of transformers, so I'd blame the video before yourself