It was trained "mainly on text" according to the article. So there might as well have been 100GB of images in the training data, too.