Data · dataset · 2022
WMT21 Metrics Shared Task
Listed in Hugging Face Datasets
This shared task will examine automatic evaluation metrics for machine translation.
Description
We will provide you with MT system outputs along with source text and the human reference translations. We are looking for automatic metric scores for translations at the system-level, and segment-level.
We will calculate the system-level, and segment-level correlations of your scores with human judgements. We invite submissions of reference-free metrics in addition to reference-based metrics.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/muibk/wmt21_metrics_task ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/muibk/wmt21_metrics_task ↗
metadata API · from Hugging Face
Topics
- Stated by source
- translation
- From keywords
- Computer Science & AI
- Inferred from text
- Text 75%
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | muibk/wmt21_metrics_task | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:translation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |