Data · dataset · 2026
IWSLT14 German-English, WMT14 English-German, and WMT16 English-Romanian
Listed in ScienceDB
We conducted experiments on three widely used machine translation benchmarks: IWSLT14 German-English (De-En, ~160K sentence pairs), WMT14 English-German (En-De, ~4.5M sentence pairs), and WMT16 English-Romanian (En-Ro, ~610K sentence pairs).
Description
All datasets follow the standard splits of the respective benchmarks, and subword vocabularies are constructed using Byte Pair Encoding (BPE) to alleviate vocabulary sparsity and unify token granularity.
Links
Where it is published
- DOI doi.org/10.57760/sciencedb.j00104.00151 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.57760%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Earth & Environmental Science · Engineering · Humanities · Life Sciences · Social Science
- Inferred from text
- Language studies 69%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.57760/sciencedb.j00104.00151 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].anzsrc:group:4703 | enrichment · scidb cn | taxonomy-embedding@1.0.0 | title+keywords+description (69%) |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/rights |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |