This feature is back in iOS 17, but it doesn’t do notifications and can be enabled per-device. It basically just blurs nsfw photos when they’re on the screen. It’s great when on a business trip and sexting with the SO. You can open your messages in front of your coworkers without having to worry about the messages being open from the night before.
I would be far too worried about false-negatives to do that. Especially as they get rarer, and I'd become more confident about loading up images in public.
Big fan of keeping different forms of content separate.
I'm a bit confused here. This seems like failure analysis gives us a clear winning direction. When the system fails: would you rather a nude image show clear or a non-nude image be blurred? I think 99% of people would rather have the latter. There is little risk to a normal image being falsely flagged but the outcome is likely far worse when a nude image is not censored.
It really surprises me a lot of times how little failure analysis is done in software engineering considering it is basically the cornerstone of most physical engineering. It is critical that you design systems to fail in certain ways. That is error messaging... (Also see Blackstone's Ratio for an example in law)
Different forms for different content is a nice answer, but you also have to remember that we're talking a product for the masses. So while I don't think your answer is wrong, it is.
