It would be difficult. Mortgage interest is deductible from your taxes (up to a point), but only if it is your primary home. If we moved, we would have to pay a lot more in taxes.

The mortgage tax deduction is another thing that drives up home prices.