Text · dataset · 2022
vocab-transformers/wiki-en-passages-20210101
Listed in Hugging Face Datasets
wiki-en-passages-20210101 This is a processed dump of the English Wikipedia from 2021-01-01.
Description
Each page has been splitted into paragraphs as they appear in the text. Lists, tables and headlines had been removed.
In total it has 38,080,804 passages. Further, each article contain meta-data on the number of languages this article exists in and on the number of views this article received over a 1 year period. The articles are sorted from most popular (most languages available, most… See the full description on the dataset page: huggingface.co/datasets/vocab-transformers/wiki-en-passages-20210101.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/vocab-transformers/wiki-en-passages-20210101 ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/vocab-transformers/wiki-en-passages-20210101 ↗
metadata API · from Hugging Face
Topics
- From keywords
- Computer Science & AI
- Inferred from text
- Text 75%
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | vocab-transformers/wiki-en-passages-20210101 | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:tabular | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |