So you're saying that you can't demolish buildings on your own property (or at least not without rebuilding another of equal value), because that would lead to the city/county getting less taxes? That seems utterly absurd. What's next, not being able to paint the inside of your house puke yellow, which would also tank property values?
It would also allow you to avoid taxes on the sale of the house.