Imaging · dataset · 2022
Wikipedia-based Image Text
Listed in Hugging Face Datasets
Dataset Card for WIT Dataset
Description
Summary
Wikimedia's version of the Wikipedia-based Image Text (WIT) Dataset, a large multimodal multilingual dataset. From the official blog post: The core training data is taken from the Wikipedia Image-Text (WIT) Dataset, a large curated set of more than 37 million image-text associations extracted from Wikipedia articles in 108 languages that was recently released by Google Research. The WIT dataset offers extremely valuable data about the… See the full description on the dataset page: huggingface.co/datasets/wikimedia/wit_base.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/wikimedia/wit_base ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2103.01913 arxiv.org/abs/2103.01913 ↗
publication · from Hugging Face
- arXiv:1512.03385 arxiv.org/abs/1512.03385 ↗
publication · from Hugging Face
- arXiv:1905.00641 arxiv.org/abs/1905.00641 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/wikimedia/wit_base ↗
metadata API · from Hugging Face
Topics
- Stated by source
- image · image to text · text · text retrieval
- From keywords
- Computer Science & AI
Related
- Possibly the same asWikipedia-based Image Text
Provenance · 1 source records, 14 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | wikimedia/wit_base | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:image | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:image | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:image-to-text | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-retrieval | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |