> I don't feel this is that different from software eng jobs. We A/B test things to death just to get tiny metrics improvements.

Yes, that is also sad.