In my experience, I've found that to be the case when the meetings are already effectively pointless and not well organized. One solution is to make meetings more structured and important. This has the benefit of also making them rarer. When I've been in meetings that have clear goals and an agenda/talking points to go through so that people stay on topic, I found them to be far more bearable with mixed remote and office employees.