I still use Heroku for a few low-traffic sites where I'm not doing anything fancy (like my personal website), but once I got into managing servers with Puppet it was VPS all the way.

If you're using Rails, check out Moonshine (a great Rails-oriented wrapper around Puppet): https://github.com/railsmachine/moonshine/