Bay Area (including SF) public transportation is generally terrible, definitely not at all a great option for people who can’t even live in SF but have to commute to SF because of how expensive it is.
If you are forced to commute into SF for your job, then make living close to BART a top priority. (Many years ago, I met many people who suffered through that daily commute, but refused to make living near BART a priority. It was dumb to watch.) BART is a miracle train system (hybrid commuter rail/metro/subway), even if the coverage isn't great.
Or Caltrain. The new electrified Caltrain is a massive improvement: it runs at least every half hour all day, every day. I don’t know whether it was intentional on the part of the agency, but they stumbled upon the obvious phenomenon that many people will not use a transit system that runs too infrequently and that, conversely, if you have infrequent trains with low ridership, your ridership might return if you increase frequency.
Most of the people I knew lived in East Bay, but you raise a great point! The peninsula also has insufferable car traffic, but can be avoided during daily commutes by carefully planning your home around Caltrain.
Just because it’s in top 10 within the country doesn’t mean it is great and that people don’t need to rely on cars most of the times. “Just live near BART” is a laughable proposition since half the BART stations outside of SF do not have enough housing around them and the ones that do, have high density luxury apartments that aren’t exactly affordable to people outside tech and other high paying careers. Then there’s the question of “do I also work near BART?”, “buy groceries near bus stations?” Or “go to the hospital only near public transit?”. Answer to all of those questions is “No and I still need a car”.
