Have you used GPT-4 though? It does have reasoning capabilities, better than a clever human.

LLMs are different, but a bunch of transistors can apply reasoning to chess better than any grandmaster. That's emergent behavior.

But you don't really see anyone today trying to argue that power plants don't have the same muscles as a horse, because it gets the job done.