← Search

Data · dataset · 2026

A Chinese-Tibetan Anchor-Enhanced Parallel Corpus – CT-AEPC

Listed in ScienceDB

Tibetan is a typical low resource language, and publicly available large-scale, high-quality datasets with parallel text, retrieval structures, and factual anchor annotations are still relatively limited.

Description

To this end, this article constructs a Chinese Tibetan anchor enhanced parallel corpus CT-AEPC. This corpus is based on publicly accessible Chinese webpage text and is formed through steps such as webpage body extraction, noise cleaning, Chinese sentence segment screening, Tibetan candidate translation generation, manual proofreading, anchor point extraction, quality scoring, duplicate sample removal, sensitive information filtering, and structured encapsulation.

CT-AEPC contains a total of 99907 parallel text samples from China and Tibet, with a data format of JSONL and a data size of approximately 203.77MB. Each sample includes fields such as qid, query, positive, query_date, anchors, features, and quality_store. Among them, 'query' is a Chinese sentence segment, 'positive' is the corresponding Tibetan text, 'anchors' records verifiable factual anchor points such as date, time, and quantity,' features' records text length, anchor point quantity, language character ratio, length matching, and numerical consistency, and 'quality_store' represents the automatic structural quality assessment results of the sample.

Read the rest (1 more)

The statistical results show that the average length of Chinese text is 102.19 characters, and the average length of Tibetan text is 412.80 characters. Each sample contains an average of 4.01 factual anchor points, and the average automatic quality score is 0.9478. This language database can be used for tasks such as Chinese Tibetan machine translation, cross language retrieval, retrieval enhanced generation of positive samples, fine-tuning of low resource language models, evaluation of reordering models, and analysis of factual consistency. 

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Linguistics 71% · Text 75%
Provenance · 1 source records, 12 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.3528311 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · scidb cnconnector:scidb_cn@1.0.0
concepts[field].anzsrc:group:4704enrichment · scidb cntaxonomy-embedding@1.0.0title+keywords+description (71%)
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
concepts[modality].local:modality:textenrichment · scidb cnkeyword-concept-rules@1.0.0title+description (75%)
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
licensesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/rights
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title