Data · dataset · 2022
albertvillanova/TextCaps
Listed in Hugging Face Datasets
extCaps requires models to read and reason about text in images to generate captions about them.
Description
Specifically, models need to incorporate a new modality of text present in the images and reason over it and visual content in the image to generate image descriptions. Current state-of-the-art models fail to generate captions for images in TextCaps because they do not have text reading and reasoning capabilities.
See the examples in the image to compare ground truth answers and corresponding predictions by a state-of-the-art model.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/albertvillanova/TextCaps ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/albertvillanova/TextCaps ↗
metadata API · from Hugging Face
Topics
- From keywords
- Computer Science & AI
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | albertvillanova/TextCaps | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:image | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |