> some small fraction of 100M users

could this be just A/B testing? Do the terms of use rule out tweaking inference parameters (temperature?) even if using the same model?