I would say the fact they do better than anyone could have imagined using just language points in the same direction, okay is very much up for debate imo.

It's like people enjoy extrapolating their surprise when it comes to LLMs, and I don't think it's very helpful.