1 is false; it is both accurate and predictive to describe what these systems do as mimicking/regurgitating human output. That's exactly what they're doing.

2 is irrelevant; you can doomsay and speculate all day, but if it's detached from reality it's not meaningful as a way of understanding future likely outcomes.