Downvotes do exist, but you need to reach 500 karma to unlock them, or at least that's what the rumours say.

I don't have them, but I have seen comments in the negative, so there must be some truth to it