Constarium
← Search

Data · dataset · 2026

Prediction-Level Benchmark Metadata and Model Scores for Multi-Provider AI-Text Detection in Turkish Scholarly Abstracts

Listed in Teesside University Research Data Repository

This dataset contains prediction-level experimental metadata and derived model scores from a frozen benchmark used to evaluate AI-text detection in Turkish scholarly abstracts.

Description

The release comprises 1,678 benchmark records grouped into 60 independent source clusters: 60 human records and metadata for 1,618 AI-assisted variants. The benchmark covers seven academic domains, four generative-AI providers (OpenAI, Gemini, Claude, and DeepSeek), six prompt families, four contribution levels, and 179 adversarial transformations.

Each record includes provenance identifiers, source-cluster identifiers, binary labels, contribution metadata, provider and prompt metadata, domain and document-type variables, adversarial-operation metadata, text hashes, word counts, and three frozen model-score fields. The repository also provides raw and processed tabular releases, a data dictionary, source registry, quality-control reports, descriptive tables, authoritative results registries, deterministic validation code, statistical-analysis code, figure-generation code, software requirements, licenses, citation metadata, and SHA-256 checksums.

Read the rest (2 more)

The release is designed to support reproducible investigation of source leakage, cross-domain reliability, human false-positive rates, provider and prompt variation, calibration, threshold sensitivity, and prediction-level information quality. No full copyrighted scholarly abstracts and no full LLM-generated texts are redistributed. The repository contains experimental metadata, numerical prediction outputs, provenance identifiers, truncated content hashes, and reproducibility materials.

Dataset accuracy is verified through deterministic Python checks and cryptographic checksums rather than by generative AI.

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Tabular 75% · Text 75%
Provenance · 1 source records, 15 field assertions
SourceKeyLast seenRaw
Teesside University Research Data Repositoryoai:data.mendeley.com/pbp25fyvmv.110 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].anzsrc:field:460208mapping · researchdata tees ac ukvocabulary-mapper@1.0.0keywords['Natural Language Processing']
concepts[field].anzsrc:group:4611mapping · researchdata tees ac ukvocabulary-mapper@1.0.0keywords['Machine Learning']
concepts[field].local:field:computer-science-aimapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:engineeringmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:life-sciencesmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[modality].local:modality:tabularenrichment · researchdata tees ac ukkeyword-concept-rules@1.0.0title+description (75%)
concepts[modality].local:modality:textenrichment · researchdata tees ac ukkeyword-concept-rules@1.0.0title+description (75%)
descriptionsource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/description
licensesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/rights
publication_datesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
titlesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/title