There are a few "hints" that suggest to me algorithms will bear a lot more fruit than compute (in terms of flops):

1) there already exist very efficient algorithms for rigorous problems that LLMs perform terribly at! 2) learning is too slow and is largely offline 3) "llms aren't world models"