I have a very similar mindset, but, man, mortgages hurt. At least when paying rent the money goes towards a real person. With a mortgage such a big chunk of the payment is the interest that just goes to this faceless entity that is the bank.
Most of my landlords were faceless entities too. Obviously I’d rather the house be paid off but I didn’t have $300,000 in cash and I have to live somewhere.
How does it not bother you? :)