It's definitely starting to look like we're well into diminishing returns territory with the current LLM approach. I think GPT algorithm is a useful piece of the puzzle, but clearly some fresh ideas are needed to move forward in a meaningful way. I'm really hoping the hype will start to die down so that more effort goes into exploring other techniques instead of all the air in the room being sucked up by LLMs.