> one of my friends has a mega-sized server than he just runs builds and trains ML models on

I built my first desktop computer to do this recently. I can definitely recommend it, even for local server development. It's nice to be able to have a version of a codebase running on the remote machine so my local laptop stays cool while I'm testing.