That's exactly the feeling I wanted to provoke with my comment.
Please know that I'm actually not proposing to go through with that. But I'm fairly sure literally anyone with enough programming skills to call the Bing API and extract and run the resulting code could do it.
So I'm not nihilistic in the way you described, but I am pessimistic that somebody else is willing to go through with something like it.
Edit: The whole problem with the "AI in a box" argument from the very beginning has always been actually keeping the box closed. I'm fairly sure that just like Pandoras, boxes like these will inevitably be opened by someone (well-meaning, or otherwise).
Please know that I'm actually not proposing to go through with that. But I'm fairly sure literally anyone with enough programming skills to call the Bing API and extract and run the resulting code could do it.
So I'm not nihilistic in the way you described, but I am pessimistic that somebody else is willing to go through with something like it.
Edit: The whole problem with the "AI in a box" argument from the very beginning has always been actually keeping the box closed. I'm fairly sure that just like Pandoras, boxes like these will inevitably be opened by someone (well-meaning, or otherwise).