Data · dataset · 2026
Supplementary data for "Can AI Help German Teachers Select Level-Appropriate Texts? A Cautious Framework for CEFR Estimation"
Listed in ScienceDB
Description
This dataset supports a small exploratory pilot that compared the CEFR-level estimates of three publicly accessible AI models (Claude Opus 4.8, GPT-5.5 Pro, and Llama 4 Scout) for 14 reading texts drawn from 7 German-as-a-foreign-language (DaF) coursebooks at levels A1, B1, and C1, published between 2021 and 2024 in Germany and Türkiye. Each text was queried once per model under identical zero-shot conditions using a single prompt (provided in English and German).
Publisher CEFR labels are used as curricular reference points, not as independently validated gold standards.The package contains a codebook, a per-text coding table (anonymized metadata and each model's CEFR estimate, with agreement automatically computed against the publisher label), a summary of overall and by-level agreement, and the exact prompt and preprocessing conditions. Full coursebook passages are not included, as they are under copyright; the specific texts can be identified from the metadata and made available to editors and reviewers on request.
Links
Where it is published
- DOI doi.org/10.57760/sciencedb.42064 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.57760%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Computer Science & AI · Earth & Environmental Science · Engineering · Humanities · Life Sciences · Social Science
- Inferred from text
- Natural language processing 78% · Tabular 65% · Text 75%
Provenance · 1 source records, 14 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.57760/sciencedb.42064 | 10 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].anzsrc:field:460208 | enrichment · scidb cn | taxonomy-embedding@1.0.0 | title+keywords+description (78%) |
| concepts[field].local:field:computer-science-ai | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[modality].local:modality:tabular | enrichment · scidb cn | keyword-concept-rules@1.0.0 | title+description (65%) |
| concepts[modality].local:modality:text | enrichment · scidb cn | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/rights |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |