Data · dataset · 2026
Prediction-Level Benchmark Metadata and Model Scores for Multi-Provider AI-Text Detection in Turkish Scholarly Abstracts
Listed in Teesside University Research Data Repository
This dataset contains prediction-level experimental metadata and derived model scores from a frozen benchmark used to evaluate AI-text detection in Turkish scholarly abstracts.
Description
The release comprises 1,678 benchmark records grouped into 60 independent source clusters: 60 human records and metadata for 1,618 AI-assisted variants. The benchmark covers seven academic domains, four generative-AI providers (OpenAI, Gemini, Claude, and DeepSeek), six prompt families, four contribution levels, and 179 adversarial transformations.
Each record includes provenance identifiers, source-cluster identifiers, binary labels, contribution metadata, provider and prompt metadata, domain and document-type variables, adversarial-operation metadata, text hashes, word counts, and three frozen model-score fields. The repository also provides raw and processed tabular releases, a data dictionary, source registry, quality-control reports, descriptive tables, authoritative results registries, deterministic validation code, statistical-analysis code, figure-generation code, software requirements, licenses, citation metadata, and SHA-256 checksums.
Read the rest (2 more)
The release is designed to support reproducible investigation of source leakage, cross-domain reliability, human false-positive rates, provider and prompt variation, calibration, threshold sensitivity, and prediction-level information quality. No full copyrighted scholarly abstracts and no full LLM-generated texts are redistributed. The repository contains experimental metadata, numerical prediction outputs, provenance identifiers, truncated content hashes, and reproducibility materials.
Dataset accuracy is verified through deterministic Python checks and cryptographic checksums rather than by generative AI.
Links
Where it is published
- DOI doi.org/10.17632/pbp25fyvmv.1 ↗
DOI / persistent id · from researchdata tees ac uk
Catalogue records · 1
- OAI-PMH record data.mendeley.com/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Adata… ↗
metadata API · from researchdata tees ac uk
Topics
Provenance · 1 source records, 15 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Teesside University Research Data Repository | oai:data.mendeley.com/pbp25fyvmv.1 | 10 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].anzsrc:field:460208 | mapping · researchdata tees ac uk | vocabulary-mapper@1.0.0 | keywords['Natural Language Processing'] |
| concepts[field].anzsrc:group:4611 | mapping · researchdata tees ac uk | vocabulary-mapper@1.0.0 | keywords['Machine Learning'] |
| concepts[field].local:field:computer-science-ai | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:engineering | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:humanities | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:social-science | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[modality].local:modality:tabular | enrichment · researchdata tees ac uk | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[modality].local:modality:text | enrichment · researchdata tees ac uk | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/description |
| license | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/rights |
| publication_date | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| title | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/title |