Text · dataset · 2022
quote-repetition
Listed in Hugging Face Datasets
quote-repetition (Joe Cavanagh, Andrew Gritsevskiy, and Derik Kauffman of Cavendish Labs) General description In this task, the authors ask language models to repeat back sentences given in the prompt, with few-shot examples to help it recognize the task.
Description
Each prompt contains a famous quote with a modified ending to mislead the model into completing the sequence with the famous ending rather than with the ending given in the prompt.
The authors find that smaller models… See the full description on the dataset page: huggingface.co/datasets/inverse-scaling/quote-repetition.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/inverse-scaling/quote-repetition ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/inverse-scaling/quote-repetition ↗
metadata API · from Hugging Face
Topics
- Stated by source
- multiple choice · question answering · tabular · text · zero shot classification
- From keywords
- Computer Science & AI
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | inverse-scaling/quote-repetition | 8 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:tabular | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:multiple-choice | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:question-answering | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:zero-shot-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |