Imaging · dataset · 2023
General AI Assistants Benchmark
Listed in Hugging Face Datasets
GAIA dataset GAIA is a benchmark which aims at evaluating next-generation LLMs (LLMs with augmented capabilities due to added tooling, efficient prompting, access to search, etc).
Description
We added gating to prevent bots from scraping the dataset. Please do not reshare the validation or test set in a crawlable format.
Data and leaderboard GAIA is made of more than 450 non-trivial question with an unambiguous answer, requiring different levels of tooling and autonomy to… See the full description on the dataset page: huggingface.co/datasets/gaia-benchmark/GAIA.
Links
Get the data
- Hugging Face dataset page huggingface.co/datasets/gaia-benchmark/GAIA ↗
Gated (auto) - request access on the dataset page
landing page · request access · from Hugging Face
Documentation and papers
- arXiv:2311.12983 arxiv.org/abs/2311.12983 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/gaia-benchmark/GAIA ↗
metadata API · from Hugging Face
Topics
- From keywords
- Computer Science & AI
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | gaia-benchmark/GAIA | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:audio | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:document | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:image | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |