Extending this analogy into a question: Could the polar bear community eat enough expert food providers that their quality of food and eventually overall health declines?
Will GPTs eat themselves, or more correctly, will they dilute their training corpuses until there are no gains to make? Seems possible.
Like how we've relied on fossil fuels that are a limited resources, to get further we have to go beyond such fuels. It seems like we're in the process of locking in our highest attainable level of text-or-image based advancement.
We mine the expertise in industries (programming, music production, graphic design, ...) and simultaneously cause the replacement of many future experts. Thus leading to a lack of expert output that we can mine?
Now, currently, the problem seems to be "we're putting people out of work" -- but that's progress. The real problem is that we are unevenly distributing the benefits.
