I'd argue that if we want to support individual growth and creativity, freedom-to should have higher priority than freedom-from, which consciously or not has seems to be the traditional default in the US perhaps due to its culture of supporting innovation and its break-away past. I believe some refer to these as positive and negative freedoms, respectfully.
This is also why a number of people truly revolt against the idea of higher density living. If the only way to have your freedom-from is to be free from other people, then you move away from other people.
I've watched it play out on my mother-in-law's street. What was once a quiet dead end street is now a noisy, heavily trafficked road because a large apartment building was put up at the end.
The number of freedom-to people have significantly decreased her quality of life blasting music as they walk or drive by at all hours, along with a litany of other complaints that range from anti-social to outright illegal behavior. Even setting aside the illegal stuff, she is significantly less happy living where she is now.
