Data · dataset · 2022
OpenWebText2
Listed in Hugging Face Datasets
OpenWebText2 is part of EleutherAi/The Pile dataset and is an enhanced version of the original OpenWebTextCorpus covering all Reddit submissions from 2005 up until April 2020, with further months becoming available after the corresponding PushShift dump files are released.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/defunct-datasets/the_pile_openwebtext2 ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2101.00027 arxiv.org/abs/2101.00027 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/defunct-datasets/the_pile_openwebtext2 ↗
metadata API · from Hugging Face
Topics
- Stated by source
- fill mask · text classification · text generation
- From keywords
- Computer Science & AI
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | defunct-datasets/the_pile_openwebtext2 | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:fill-mask | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |