Constarium
← Search

Data · dataset · 2026

Supplementary data for "Can AI Help German Teachers Select Level-Appropriate Texts? A Cautious Framework for CEFR Estimation"

Listed in ScienceDB

Description

This dataset supports a small exploratory pilot that compared the CEFR-level estimates of three publicly accessible AI models (Claude Opus 4.8, GPT-5.5 Pro, and Llama 4 Scout) for 14 reading texts drawn from 7 German-as-a-foreign-language (DaF) coursebooks at levels A1, B1, and C1, published between 2021 and 2024 in Germany and Türkiye. Each text was queried once per model under identical zero-shot conditions using a single prompt (provided in English and German).

Publisher CEFR labels are used as curricular reference points, not as independently validated gold standards.The package contains a codebook, a per-text coding table (anonymized metadata and each model's CEFR estimate, with agreement automatically computed against the publisher label), a summary of overall and by-level agreement, and the exact prompt and preprocessing conditions. Full coursebook passages are not included, as they are under copyright; the specific texts can be identified from the metadata and made available to editors and reviewers on request.

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Natural language processing 78% · Tabular 65% · Text 75%
Provenance · 1 source records, 14 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.4206410 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · scidb cnconnector:scidb_cn@1.0.0
concepts[field].anzsrc:field:460208enrichment · scidb cntaxonomy-embedding@1.0.0title+keywords+description (78%)
concepts[field].local:field:computer-science-aimapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
concepts[modality].local:modality:tabularenrichment · scidb cnkeyword-concept-rules@1.0.0title+description (65%)
concepts[modality].local:modality:textenrichment · scidb cnkeyword-concept-rules@1.0.0title+description (75%)
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
licensesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/rights
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title