AI makes stuff up, film at 11. It's literally a language model. It's just guessing what word follows another in a text, that's all it does. How's this different from the earlier incidents where that same Google AI would suggest that you should put glue on your pizza or eat rocks as a tasty snack?
I understand what you're saying in principle, but empirically society doesn't seem to be able to do this now even excepting AI hallucinations. So in practical terms, given the society we do have, what to do?