Data · dataset · 2022
TAPE (Text Attack and Perturbation Evaluation)
Listed in Hugging Face Datasets
The Winograd schema challenge composes tasks with syntactic ambiguity, which can be resolved with logic and reasoning (Levesque et al., 2012).
Description
The texts for the Winograd schema problem are obtained using a semi-automatic pipeline. First, lists of 11 typical grammatical structures with syntactic homonymy (mainly case) are compiled.
For example, two noun phrases with a complex subordinate: 'A trinket from Pompeii that has survived the centuries'. Requests corresponding to these constructions are submitted in search of the Russian National Corpus, or rather its sub-corpus with removed homonymy. In the resulting 2+k examples, homonymy is removed automatically with manual validation afterward.
Read the rest (1 more)
Each original sentence is split into multiple examples in the binary classification format, indicating whether the homonymy is resolved correctly or not.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/RussianNLP/tape ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2210.12813 arxiv.org/abs/2210.12813 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/RussianNLP/tape ↗
metadata API · from Hugging Face
Topics
- Stated by source
- multiple choice · question answering · text classification
- From keywords
- Computer Science & AI
- Inferred from text
- Text 75%
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | RussianNLP/tape | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:multiple-choice | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:question-answering | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |