Data · dataset · 2022
Liv4ever
Listed in Hugging Face Datasets
Livonian is one of the most endangered languages in Europe with just a tiny handful of speakers and virtually no publicly available corpora.
Description
In this paper we tackle the task of developing neural machine translation (NMT) between Livonian and English, with a two-fold aim: on one hand, preserving the language and on the other – enabling access to Livonian folklore, lifestories and other textual intangible heritage as well as making it easier to create further parallel corpora.
We rely on Livonian's linguistic similarity to Estonian and Latvian and collect parallel and monolingual data for the four languages for translation experiments. We combine different low-resource NMT techniques like zero-shot translation, cross-lingual transfer and synthetic data creation to reach the highest possible translation quality as well as to find which base languages are empirically more helpful for transfer to Livonian.
Read the rest (1 more)
The resulting NMT systems and the collected monolingual and parallel data, including a manually translated and verified translation benchmark, are publicly released. Fields: - source: source of the data - en: sentence in English - liv: sentence in Livonian
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/tartuNLP/liv4ever ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/tartuNLP/liv4ever ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text generation · translation
- From keywords
- Computer Science & AI
- Inferred from text
- Artificial intelligence 69%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | tartuNLP/liv4ever | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].anzsrc:group:4602 | enrichment · Hugging Face | taxonomy-embedding@1.1.0 | title+keywords+description (69%) |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:translation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |