Except that we know that even if you can't put your finger on what it is right now, there's something in the way of "ChatGPT just literally prints money" being at all realistic. It's pretty obvious in the markets if anyone has figured out a repeatable strategy for printing money.
This is to say that we know from looking at outcomes over the long term that the kinds of concrete gains you're describing are offset by subtler kinds of losses which most likely you would struggle to describe as decimal numbers but which are equally real in their impact on your business.
>This is to say that we know from looking at outcomes over the long term
Public LLMs have been around for 3 years, and adoption is still nascent. We don't have any long term data, and the longest term data we have involves a bunch of outdated models. Most people are still awful at using LLMs, and probably the most skilled users are the college kids who are graduating right now (the youth is always god-tier with new tech).
I cannot think of anything more foolish right now than not trying to leverage SOTA models to save you money, especially because you heard rumors of shadow losses that can only be found in the bottom line.
I think saying you can't imagine anything more foolish makes you look the fool. You just pick which evidence you'd prefer to ignore and go on with being told "you're absolutely right" all day.
This is to say that we know from looking at outcomes over the long term that the kinds of concrete gains you're describing are offset by subtler kinds of losses which most likely you would struggle to describe as decimal numbers but which are equally real in their impact on your business.