Table · dataset · 2026
Data and code for 'When Retrieval Can Hurt' (Arabic MCQ generation, 2×2 human evaluation)
Listed in figshare
<p dir="ltr">This deposit holds the research data and analysis code behind a study on automatically writing Arabic multiple-choice questions with large language models.
Description
The work tests whether adding retrieved reference passages and an automatic self-revision step improves question quality, using a four-condition experiment across 31 driving-education topics judged by a panel of raters in three stakeholder roles.</p><p><br></p><p dir="ltr">Included here are the model-produced questions for every condition, the panel's anonymised scores (raters labelled by role only), the computed text-similarity and audit measures, and the scripts that run the statistics and build the figures.
Retrieved passages appear as file-and-page references rather than as text, and the copyrighted source lessons are not shared; only generated items and derived results are provided.</p>
Links
Where it is published
- DOI doi.org/10.6084/m9.figshare.33940903.v1 ↗
DOI / persistent id · from figshare com
Catalogue records · 1
- OAI-PMH record api.figshare.com/v2/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Af… ↗
metadata API · from figshare com
Topics
- From keywords
- Astronomy & Astrophysics · Chemistry · Computer Science & AI · Earth & Environmental Science · Economics & Finance · Engineering · Humanities · Life Sciences · Medicine & Health · Natural language processing · Ocean & Atmospheric Science · Social Science
- Inferred from text
- Text 75%
Provenance · 1 source records, 18 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| figshare | oai:figshare.com:article/33940903 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].anzsrc:field:460208 | mapping · figshare com | vocabulary-mapper@1.0.0 | keywords['Natural language processing'] |
| concepts[field].local:field:astronomy | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:chemistry | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:economics-finance | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:engineering | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:humanities | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:social-science | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · figshare com | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/description |
| license | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/rights |
| publication_date | source · figshare com | connector:figshare_com@1.0.0 | |
| title | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/title |