And it does. A live band on a bigger stage with improper monitoring (too far away, not existent) isn't fun to play in.

That "bigger" is certainly more than two meters.

Not sure why you picked up downvotes on this comment because I think you’re right. 5 ms is not at all a lot of latency. I think even very exacting professional musicians would be hard pressed to detect it. At 128 samples and using the Push 3 as an audio interface on my M1, round trip latency is 13 ms, and even that is not a frustrating amount of latency.

I think that there's just a lot of voodoo floating around regarding audio.