The argument may make sense at a 'hyper local' level but be bad overall. Everywhere is trying to prevent the next level down from getting into their area. At a high level this means economic segregation enforced by the government. A very working class suburb near me has a bunch of neighbors trying to prevent an apartment complex on the site of a former K-Mart. It is not an exclusive area, but the same arguments are being applied.