Data · dataset · 2022
WikiBio
Listed in Hugging Face Datasets
This dataset gathers 728,321 biographies from wikipedia.
Description
It aims at evaluating text generation algorithms. For each article, we provide the first paragraph and the infobox (both tokenized).
For each article, we extracted the first paragraph (text), the infobox (structured data). Each infobox is encoded as a list of (field name, field value) pairs. We used Stanford CoreNLP (stanfordnlp.github.io/CoreNLP/) to preprocess the data, i.e. we broke the text into sentences and tokenized both the text and the field values.
Read the rest (1 more)
The dataset was randomly split in three subsets train (80%), valid (10%), test (10%).
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/michaelauli/wiki_bio ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:1603.07771 arxiv.org/abs/1603.07771 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/michaelauli/wiki_bio ↗
metadata API · from Hugging Face
Topics
- Stated by source
- table to text
- From keywords
- Computer Science & AI
- Inferred from text
- Library and information studies 68% · Text 75%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | michaelauli/wiki_bio | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].anzsrc:group:4610 | enrichment · Hugging Face | taxonomy-embedding@1.1.0 | title+keywords+description (68%) |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:table-to-text | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |