Data · dataset · 2026
LLMs in Genetics MCQs
Listed in ScienceDB
Description
Project
OverviewThis dataset supports a study evaluating the performance and reliability of five large language models (LLMs) — Gemini, Claude, ChatGPT, Copilot, and DeepSeek — in answering genetics multiple-choice questions (MCQs) in a medical education context. The study used 200 USMLE-style MCQs distributed across 20 genetics topics, with each LLM completing three independent testing sessions. Questions were additionally classified by Bloom's Taxonomy levels (1–4) to assess performance across cognitive complexity levels.Questions.csv contains 200 rows — one per MCQ.
Read the rest (2 more)
Each question is tagged with a Bloom's Taxonomy level (1–4), and the five LLM columns (Gemini, Claude, ChatGPT, Copilot, DeepSeek) show the average score across 3 independent attempts, where 1.0 = always correct, 0.0 = always incorrect, and values in between (e.g., 0.67) indicate the model got it right in 2 out of 3 attempts.Topics.csv contains 20 rows — one per genetics topic. For each of the five LLMs, there are three separate columns (A1, A2, A3) representing the percentage of correct answers in each individual testing session.
This allows both within-model consistency (reliability across attempts) and between-model comparisons to be assessed at the topic level.Together, the two files capture performance at two levels of granularity: question-level (with Bloom's classification) and topic-level (with attempt-by-attempt breakdown), enabling analysis of both accuracy and test-retest reliability across cognitive complexity levels and subject areas.
Links
Where it is published
- DOI doi.org/10.57760/sciencedb.33963 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.57760%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Computer Science & AI · Earth & Environmental Science · Economics & Finance · Engineering · Humanities · Life Sciences · Medicine & Health · Social Science
- Inferred from text
- Clinical sciences 72%
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.57760/sciencedb.33963 | 10 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:group:3202 | enrichment · scidb cn | taxonomy-embedding@1.0.0 | title+keywords+description (72%) |
| concepts[field].local:field:computer-science-ai | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:economics-finance | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license_text | source · scidb cn | connector:scidb_cn@1.0.0 | |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |