Data · dataset · 2022
Evaluation data set of Word Segmentation technology in Minority Languages (MLWS2021)
Listed in ScienceDB
MLWS2021 word segmentation evaluation data set includes Mongolian, Tibetan and Uyghur languages.
Description
The evaluation object is the core technology of automatic word segmentation in Mongolian, Uyghur and Tibetan Languages. On the basis of MLWS2017, the data set is expanded from the previous news field to news, economy, law, entertainment and other fields; The data scale has also expanded from more than 30000 sentences before to 155000 sentences at present.
The dataset includes three data files, including: (1) Tibetan.Zip is Tibetan word segmentation and annotation data, with a data volume of 25000 sentences and a file size of 1.52MB; (2) Mongolian.Zip is Mongolian word segmentation and annotation data, with a data volume of 65000 sentences and a file size of 3.16MB; (3)Uyghur.Zip is Uighur word segmentation and annotation data, with a data volume of 65000 sentences and a file size of 5.12MB.
Links
Where it is published
- DOI doi.org/10.11922/sciencedb.j00001.00340 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.11922%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Earth & Environmental Science · Engineering · Humanities · Life Sciences · Social Science
- Inferred from text
- Linguistics 71%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.11922/sciencedb.j00001.00340 | 9 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].anzsrc:group:4704 | enrichment · scidb cn | taxonomy-embedding@1.0.0 | title+keywords+description (71%) |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/rights |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |