Make the up and down arrows slightly further apart, or make the up arrow bigger. I still worry that I might accidentally down-vote someone, which is made worse by the fact that the arrow disappears once it's done (and is thus not undoable).