You make a compelling point. But not everyone has such a thick skin or is that relaxed about getting vented on... maybe if downvoting cost karma and there was a karma threshold for being the recipient of a downvote? That could be interesting: battle of the karma titans. Meanwhile, new people could get their feet wet without getting pilloried for their mistakes.
Oh, I'm not thick-skinned. I sit at my computer and whine to my two adult sons with the voice of a 3 year old about how nobody likes me, nobody talks to me, I have no friends and I got DOWNVOTED -- when I may have 20 upvotes and 1 downvote. I just think it's the lesser evil.