You are making some interesting assumptions about non-work interests. I don’t mind working in the office 3-4 days/week, and have plenty of Non-work interests: restaurants, photography, dancing, live music, hanging out with friends. I live, work, and play in the city. I can pursue my social activities within minutes of leaving work.
This sounds like a problem with the location of that particular office, not with the discussuion of in-place work/work from home. I live a nice bike trip from work and I cannot stand working at home anymore. And I'm an extreme introvert: I don't yearn for social contact, it's just that my office is very comfortable.