Table · dataset · 2022
wiki-paragraphs
Listed in Hugging Face Datasets
Dataset Card for wiki-paragraphs Dataset
Description
Summary
The wiki-paragraphs dataset is constructed by automatically sampling two paragraphs from a Wikipedia article. If they are from the same section, they will be considered a "semantic match", otherwise as "dissimilar". Dissimilar paragraphs can in theory also be sampled from other documents, but have not shown any improvement in the particular evaluation of the linked work.The alignment is in no way meant as an accurate… See the full description on the dataset page: huggingface.co/datasets/dennlinger/wiki-paragraphs.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/dennlinger/wiki-paragraphs ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2012.03619 arxiv.org/abs/2012.03619 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/dennlinger/wiki-paragraphs ↗
metadata API · from Hugging Face
Topics
- Stated by source
- sentence similarity · text · text classification
- From keywords
- Computer Science & AI
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | dennlinger/wiki-paragraphs | 10 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:sentence-similarity | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |