Table · dataset · 2022
codeparrot/github-jupyter-parsed
Listed in Hugging Face Datasets
GitHub Jupyter Dataset Dataset Description This is a parsed and preprocessed version of GitHub-Jupyter Dataset, a dataset extracted from Jupyter Notebooks on BigQuery.
Description
We only keep markdown and python cells and convert the markdown to text. Some heuristics are also applied to filter notebooks with little data and very long or very short cells.
Licenses Each example has the license of its associated repository. There are in total 15 licenses: [ 'mit'… See the full description on the dataset page: huggingface.co/datasets/codeparrot/github-jupyter-parsed.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/codeparrot/github-jupyter-parsed ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/codeparrot/github-jupyter-parsed ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text · text generation
- From keywords
- Computer Science & AI
- Inferred from text
- Text 75%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | codeparrot/github-jupyter-parsed | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |