A little bit unrelated, but the rise of Transformers in 2022 was because of the compute available - in 2018, it would have been almost impossible to make something like GPT-4.