>Network delay can be just a few milliseconds even across a city

Sure. If you constraint it a little more, you can also just play to the persons in the next room directly (no streaming required).

For country level or worse global collaboration latency will always be a problem however...