People noticed from the start that ChatGPT is horrible at long additions and it would essentially produce random answers, and it's surprisingly simple why it fails: The way this works it cuts the sentences we input into strings of symbols from left to right and then passes these chunks of text through the neural network. When it comes to addition this fails because to add numbers we have to do it "from right to left".