Safari isn't a good browser for modern powerful web apps. I stopped using it once it killed an active Google Meet tab. Hello, I'm talking here, I don't care how resource-intensive it is right now, give me a warning if you'd like.

That wouldn't solve most of your problems, but on my M1 MBP I very rarely get any freezes with Sheets, and I often have thousands of rows there.