Text · dataset · 2022
mC4_nl_cleaned
Listed in Hugging Face Datasets
Dataset Card for Clean Dutch mC4 Dataset
Description
Summary
A cleaned version (151GB) of the Dutch part (277GB) of the C4 multilingual dataset (mC4). Based on the Common Crawl dataset. The original version was prepared by AllenAI, hosted at the address huggingface.co/datasets/allenai/c4.
Read the rest (1 more)
Preprocessing The Dutch portion of mC4 was cleaned in a similar fashion as the English cleaned C4 version. See GitLab for details. In summary, the preprocessing procedure… See the full description on the dataset page: huggingface.co/datasets/yhavinga/mc4_nl_cleaned.
Links
Get the data
- Hugging Face dataset page huggingface.co/datasets/yhavinga/mc4_nl_cleaned ↗
Gated (auto) - request access on the dataset page
landing page · request access · from Hugging Face
Documentation and papers
- arXiv:1910.10683 arxiv.org/abs/1910.10683 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/yhavinga/mc4_nl_cleaned ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text · text generation
- From keywords
- Computer Science & AI
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | yhavinga/mc4_nl_cleaned | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |