Also by the time ChatGPT really broke through in public consciousness it had already had a lot of people who had been interacting with its web API providing good RL-HF training.