I always figured why not pay someone else to deal with these problems? Not that I end up paying Heroku very much at our current scale.

Sure there might be an in-between period where we are doing a large amount of traffic on Heroku + paying too much for it, but by then we will be able to afford to hire someone who can set us up properly + at the right price. Either way, I avoid wasting time configuring servers!