Text · dataset · 2022
transformersbook/codeparrot
Listed in Hugging Face Datasets
CodeParrot 🦜 Dataset What is it?
Description
This is the full CodeParrot dataset. It contains Python files used to train the code generation model in Chapter 10: Training Transformers from Scratch in the NLP with Transformers book.
You can find the full code in the accompanying Github repository. Creation It was created with the GitHub dataset available via Google's BigQuery. It contains approximately 22 million Python files and is 180 GB (50 GB compressed) big.
Read the rest (1 more)
The… See the full description on the dataset page: huggingface.co/datasets/transformersbook/codeparrot.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/transformersbook/codeparrot ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/transformersbook/codeparrot ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text
- From keywords
- Computer Science & AI
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | transformersbook/codeparrot | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |