It seems that there is stronger evidence that model architecture is more important than sheer number of parameters/computational complexity. Compare VGG-16 with something like MobileNet or ResNet-18.