Putting more space between the up and down could help -- for example putting the down vote on the other side of the total or even further right.

yeah i accidently click on the down button all the time on my windows phone too; just did it today again...

I would say that's more of an iPhone problem. I like the design as it is right now.