Table · dataset · 2022
WikiSnippets
Listed in Hugging Face Datasets
Dataset Card for "wiki_snippets" Dataset
Description
Summary
Wikipedia version split into plain text snippets for dense semantic indexing. Supported Tasks and Leaderboards More Information Needed Languages More Information Needed Dataset Structure We show detailed information for 2 configurations of the dataset (with 100 snippet passage length and 0 overlap) in English: wiki40b_en_100_0: Wiki-40B wikipedia_en_100_0: Wikipedia Data Instances… See the full description on the dataset page: huggingface.co/datasets/community-datasets/wiki_snippets.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/community-datasets/wiki_snippets ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/community-datasets/wiki_snippets ↗
metadata API · from Hugging Face
Topics
- Stated by source
- other · tabular · text · text generation
- From keywords
- Computer Science & AI
- Inferred from text
- Text 75%
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | community-datasets/wiki_snippets | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:tabular | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:other | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |