Table · dataset · 2022
Catalan General Crawling
Listed in Hugging Face Datasets
Dataset Card for Catalan General Crawling Dataset
Description
Summary
The Catalan General Crawling Corpus is a 435-million-token web corpus of Catalan built from the web. It has been obtained by crawling the 500 most popular .cat and .ad domains during July 2020. It consists of 434,817,705 tokens, 19,451,691 sentences and 1,016,114 documents.
Read the rest (1 more)
Documents are separated by single new lines. It is a subcorpus of the Catalan Textual Corpus. This work is licensed under a Creative Commons… See the full description on the dataset page: huggingface.co/datasets/projecte-aina/catalan_general_crawling.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/projecte-aina/catalan_general_crawling ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2107.07903 arxiv.org/abs/2107.07903 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/projecte-aina/catalan_general_crawling ↗
metadata API · from Hugging Face
Topics
- From keywords
- Computer Science & AI
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | projecte-aina/catalan_general_crawling | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:fill-mask | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |