The hardware resources are there. I for example have access to clusters with hundreds of A100.
The engineering resources are not though. The work has to either be done by the Phds themselves or by student workers. Phds don't have enough time and student workers have very little time and no expertise.
There are some limited SWE positions in support roles, but as you can expect the pay is not competitive.
For some reason even in academic departments where we can build billion euro clusters the people are still paid utter crap.
We are an academic group (sort of) that is looking to stand up a server or so for some public-facing apps and databases, but it's like no one has ever heard of such a thing. They keep giving me servers that are behind a firewall and only accessible on-campus.
We could maybe do AWS or Azure, but that is really expensive and not really covered by our (government) funding. Plus, any time you want to do something like that (particularly with a company the university doesn't have an existing contract with), you have to get several layers of bureaucracy (including lawyers sometimes) involved. We are a state school, so you can guess how fast that moves.
In general, it's easier to ask for a $500k instrument, or take $10k trips to conferences, than get $10/month subscription for some web hosting company. Academia can be really behind on this front.
(For me, academia is generally ok and fun in my current position, but this part is getting ridiculous)
> In general, it's easier to ask for a $500k instrument, or take $10k trips to conferences, than get $10/month subscription for some web hosting company. Academia can be really behind on this front.
Had to fight to get paid most months; but the $2mil grant for a computing cluster went through and the Supervisor never had a problem getting their monthly trip to a conference through.
Have you looked into cloudflare tunnels/ngrok? You can expose any service to internet without dealing with ip addresses, firewalls or opening ports, etc.
And tailscale can also give you a private access to any resources even if it's behind firewalls and all that (say you want to access the gpu cluster from your laptop at home).
And they can all run in user space without elevated privileges.
We are starting to build up the field of research facilitation, but it's hard to bring together permanent funding for things like this; quality engineers don't want to be on funding that may vanish in 4-5 years, and most universities don't have the culture to put the necessary central funding forward at the scale required.
> For some reason even in academic departments where we can build billion euro clusters the people are still paid utter crap.
Billion euro clusters are one-time money; people expect benefits and durable employment.
> quality engineers don't want to be on funding that may vanish in 4-5 years
I may not be a quality engineer, but I'd be interested. That's a long enough time frame for me.
But by what I hear from German academia the pay is bad, the environment is "meh" and the contracts have to be renewed in relatively short periods (yearly?). That makes an otherwise interesting field a hell of a lot harder to choose.
Haven't national research labs solved this problem? Nobody I talked to at APL seemed to have any concern about shortage of R&D opportunities and although it wasn't Silicon Valley money (which is not sustainable long-term anyway), I don't recall anyone complaining about the salary either.
There was a thread on this on HN last month: "Ask HN: Has anyone worked at the US National Labs before?"[1]
Most comments note how the pay is less than FAANG; eg the top voted comments:
"Pay is pretty good by almost any standards except FAANG."
And elsewhere:
"The pay at a DOE lab is less than FAANG (PhD student interns might be around $80k/yr and starting staff scientists maybe $130k/yr), but the tradeoff for some people would be the research-flavor of the work, and the flexibility."
I'm assuming they meant sustainable for a single person. The percentage of people holding such a salary long-term could be very low. I don't know whether or not it is, but that is how I read the comment.
The national research labs are great, but there are only 17 of those, and they don't employ that many people when compared to the software industry. Good gigs if you can get them, certainly.
The R1 tier do; that’s kind of the point. But most aren’t really schools in the normal sense. E.g. MIT is basically a huge research lab with a small undergraduate school bolted on
A friend of mine is part of the jury that decides on how to distribute millions of euros in EU research grants. There are 6 professors in the jury and the their compensation is exactly 100 euro per decision. You could essentially just make up a bullshit "project", bribe 3 of them with a few thousand bucks and secure yourself a million euro research grant.
The engineering resources are not though. The work has to either be done by the Phds themselves or by student workers. Phds don't have enough time and student workers have very little time and no expertise.
There are some limited SWE positions in support roles, but as you can expect the pay is not competitive.
For some reason even in academic departments where we can build billion euro clusters the people are still paid utter crap.