Data · dataset · 2022
ZEST
Listed in Hugging Face Datasets
ZEST tests whether NLP systems can perform unseen tasks in a zero-shot way, given a natural language description of the task.
Description
It is an instantiation of our proposed framework "learning from task descriptions". The tasks include classification, typed entity extraction and relationship extraction, and each task is paired with 20 different annotated (input, output) examples.
ZEST's structure allows us to systematically test whether models can generalize in five different ways.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/allenai/zest ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2011.08115 arxiv.org/abs/2011.08115 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/allenai/zest ↗
metadata API · from Hugging Face
Topics
- Stated by source
- question answering · token classification
- From keywords
- Computer Science & AI
- Inferred from text
- Artificial intelligence 72%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | allenai/zest | 10 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].anzsrc:group:4602 | enrichment · Hugging Face | taxonomy-embedding@1.1.0 | title+keywords+description (72%) |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:question-answering | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:token-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |