Table · dataset · 2024
Pt-Corpus
Listed in Hugging Face Datasets
Portuguese-Corpus Dataset
Description
Summary
Portuguese-Corpus is a concatenation of several portions of Brazilian Portuguese datasets found in the Hub. In a tokenized format, the dataset (uncompressed) weighs 50 GB and has approximately 4.1B tokens. This version does not have instructional content.
Read the rest (1 more)
Supported Tasks and Leaderboards This dataset can be utilized for tasks involving language modeling. Languages Portuguese. Dataset Structure… See the full description on the dataset page: huggingface.co/datasets/nicholasKluge/Pt-Corpus.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/nicholasKluge/Pt-Corpus ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2112.11446 arxiv.org/abs/2112.11446 ↗
publication · from Hugging Face
- arXiv:2401.16640 arxiv.org/abs/2401.16640 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/nicholasKluge/Pt-Corpus ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text · text generation
- From keywords
- Computer Science & AI
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | nicholasKluge/Pt-Corpus | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |