> I've seen very little convincing discussion about what to do about this problem.

I think we will need adversarial AI agents whose task is to monitor other agents for anything suspicious. Every input and output would be scrutinized and either approved or rejected.