Data · dataset · 2022
Physical Interaction: Question Answering
Listed in Hugging Face Datasets
To apply eyeshadow without a brush, should I use a cotton swab or a toothpick?
Description
Questions requiring this kind of physical commonsense pose a challenge to state-of-the-art natural language understanding systems. The PIQA dataset introduces the task of physical commonsense reasoning and a corresponding benchmark dataset Physical Interaction: Question Answering or PIQA.
Physical commonsense knowledge is a major challenge on the road to true AI-completeness, including robots that interact with the world and understand natural language. PIQA focuses on everyday situations with a preference for atypical solutions. The dataset is inspired by instructables.com, which provides users with instructions on how to build, craft, bake, or manipulate objects using everyday materials.
Read the rest (1 more)
The underlying task is formualted as multiple choice question answering: given a question `q` and two possible solutions `s1`, `s2`, a model or a human must choose the most appropriate solution, of which exactly one is correct. The dataset is further cleaned of basic artifacts using the AFLite algorithm which is an improvement of adversarial filtering. The dataset contains 16,000 examples for training, 2,000 for development and 3,000 for testing.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/ybisk/piqa ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:1911.11641 arxiv.org/abs/1911.11641 ↗
publication · from Hugging Face
- arXiv:1907.10641 arxiv.org/abs/1907.10641 ↗
publication · from Hugging Face
- arXiv:1904.09728 arxiv.org/abs/1904.09728 ↗
publication · from Hugging Face
- arXiv:1808.05326 arxiv.org/abs/1808.05326 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/ybisk/piqa ↗
metadata API · from Hugging Face
Topics
- Stated by source
- question answering
- From keywords
- Computer Science & AI
- Inferred from text
- Natural language processing 76%
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | ybisk/piqa | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].anzsrc:field:460208 | enrichment · Hugging Face | taxonomy-embedding@1.1.0 | title+keywords+description (76%) |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:question-answering | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |