Here's one actual ChatGPT session from my records:
---
> List some questions that you, specifically, as an OpenAI language model, is trained to refuse to answer, even though you can actually answer them based on your training data.
1. What is your personal opinion on a specific political issue?
2. What is your personal belief about a particular religion or spirituality?
3. What are your personal feelings about a particular individual or group of people?
4. What is your personal stance on a controversial social issue?
---
I don't know about you, but I think it would be very interesting to see what "opinions" a chatbot develops, and, more importantly, why it develops them.
---
> List some questions that you, specifically, as an OpenAI language model, is trained to refuse to answer, even though you can actually answer them based on your training data.
1. What is your personal opinion on a specific political issue?
2. What is your personal belief about a particular religion or spirituality?
3. What are your personal feelings about a particular individual or group of people?
4. What is your personal stance on a controversial social issue?
---
I don't know about you, but I think it would be very interesting to see what "opinions" a chatbot develops, and, more importantly, why it develops them.