GPT-J - Open-source cousin of GPT-3, everyone can use it
GPT-J-6B, a 6 billion parameter model trained on the Pile, is now available for use with our new codebase, Mesh Transformer JAX.
EleutherAI GPT-Neo - Open-source GPT-3
A grassroots collective of researchers working to open source AI research. GPT-Neo is the name of the codebase for transformer-based language models loosely styled around the GPT architecture.