Yeah, but that's really like saying "but people can be happy while they are fasting" to somebody that is being starved.
Something being voluntary often makes the difference between it being considered harmful or even torture and a weird thing.
In aggregate, less sex may be a bad thing. In aggregate, more sex may be a good thing. That's what's being discussed.
Individuals and anecdotes just distract from the discussion.