Property crime contributes substantially to a feeling of unsafety. You can't just ignore it because you didn't get mugged. If your car window gets smashed you're going to feel unsafe too, you know. And you encounter it much more often than violent crime, so it has a larger effect on your feeling of safety of your surroundings.

The data in my link shows SF has disproportionately bad property crime per capita compared to every other wealthy city: NYC, Chicago, San Jose, LA, etc.