LLMs, by themselves, are going to hit a dead end. They are not enough to be an AGI, or even a true AI. The question is whether LLMs can be a part of something bigger. That, as you say, is not something anyone can currently answer for sure.