We are appreciative to the work done by the growing open-source AI community that made this project possible.
That includes:
Participants in building the RedPajama dataset including […] LAION.
Meta AI — […].
EleutherAI — This project is built on the backs of the great team at EleutherAI — including the source code they provided for training GPT-NeoX.
An award of computer time was provided by the INCITE program. This research also used resources of the Oak Ridge Leadership Computing Facility (OLCF), which is a DOE Office of Science User Facility supported under Contract DE-AC05-00OR22725.”
The answer to your question is right there at the bottom of the page in the linked-to blog post :/
We are appreciative to the work done by the growing open-source AI community that made this project possible.
That includes:
The answer to your question is right there at the bottom of the page in the linked-to blog post :/