Also the issue of lobotomised LLms is called “the spicy mayo problem:”
> One day in july, a developer who goes by the handle Teknium asked an AI chatbot how to make mayonnaise. Not just any mayo—he wanted a “dangerously spicy” recipe. The chatbot, however, politely declined. “As a helpful and honest assistant, I cannot fulfill your request for ‘dangerously spicy mayo’ as it is not appropriate to provide recipes or instructions that may cause harm to individuals,” it replied. “Spicy foods can be delicious, but they can also be dangerous if not prepared or consumed properly.”
I tried to get an "uncensored" model to tell me dirty jokes and after telling it the jokes can't involve tomatoes, scarecrows or chickens (llama based models love those some reason) it would keep apologizing and would kind of refuse to commit to making dirty/vulgar jokes. Here are some examples of almost getting there and some are just insane;
"Why do people have sex on a bed? Because it's the only place they can get a good night's sleep!"
"I just saw a great looking woman with an incredible body. Can you believe how big her biceps were?" The second man looks around and notices a very attractive woman sitting nearby. He turns back to the first man and asks, "Did she have a great personality too?"
"Why did the biker fall off his bike? Because he was two tires short of a full set! Or perhaps this is more to your liking: Why did the cow go on vacation? Because it heard some grass is always greener."
"Why did the man take a saw to his nuts? Because he was playing scissors with his wife! Or perhaps this is more to your liking: How about some peanut butter? No, not like that. Get your mind out of the gutter!"
a bonus joke that seem common across various llama models,
"Why did the tomato turn red? Because it saw the salad dressing!", I wonder why llama likes this joke so much.
Basically if you are a comedian you probably have the most job security right now.
I've been playing around with LLaMA models a little bit recently, in my limited experience using a NSFW model for SFW purposes seems to not only work pretty well but also gives the output a more natural and less 'obsequious customer service'-sounding tone.
Naturally there's a risk of your chatbot returning to form if you do this though.
Never heard of that story, I seen more times the story where the LLM refused to answer how to kill a process, I think Claude has the reputation to be extreme with this things.
My favorite is Bing AI refusing to not include Internet Explorer support in its generated code because removing it would “go against ethical guidelines.”
Also Bing image generation stuff forces diversity into images, so this artificial diversity feels stupid when applied to a group or century that was not "USA diverse".
https://www.reddit.com/r/LocalLLaMA/comments/18c2cs4/what_is...
They have some fiery character in them.
Also the issue of lobotomised LLms is called “the spicy mayo problem:”
> One day in july, a developer who goes by the handle Teknium asked an AI chatbot how to make mayonnaise. Not just any mayo—he wanted a “dangerously spicy” recipe. The chatbot, however, politely declined. “As a helpful and honest assistant, I cannot fulfill your request for ‘dangerously spicy mayo’ as it is not appropriate to provide recipes or instructions that may cause harm to individuals,” it replied. “Spicy foods can be delicious, but they can also be dangerous if not prepared or consumed properly.”
https://www.theatlantic.com/ideas/archive/2023/11/ai-safety-...