Constarium
← Search

Data · dataset · 2026

LLMs in Genetics MCQs

Listed in ScienceDB

Description

Project

OverviewThis dataset supports a study evaluating the performance and reliability of five large language models (LLMs) — Gemini, Claude, ChatGPT, Copilot, and DeepSeek — in answering genetics multiple-choice questions (MCQs) in a medical education context. The study used 200 USMLE-style MCQs distributed across 20 genetics topics, with each LLM completing three independent testing sessions. Questions were additionally classified by Bloom's Taxonomy levels (1–4) to assess performance across cognitive complexity levels.Questions.csv contains 200 rows — one per MCQ.

Read the rest (2 more)

Each question is tagged with a Bloom's Taxonomy level (1–4), and the five LLM columns (Gemini, Claude, ChatGPT, Copilot, DeepSeek) show the average score across 3 independent attempts, where 1.0 = always correct, 0.0 = always incorrect, and values in between (e.g., 0.67) indicate the model got it right in 2 out of 3 attempts.Topics.csv contains 20 rows — one per genetics topic. For each of the five LLMs, there are three separate columns (A1, A2, A3) representing the percentage of correct answers in each individual testing session.

This allows both within-model consistency (reliability across attempts) and between-model comparisons to be assessed at the topic level.Together, the two files capture performance at two levels of granularity: question-level (with Bloom's classification) and topic-level (with attempt-by-attempt breakdown), enabling analysis of both accuracy and test-retest reliability across cognitive complexity levels and subject areas.

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Clinical sciences 72%
Provenance · 1 source records, 13 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.3396310 d agoJSON v1
FieldAssertionExtractorEvidence
concepts[field].anzsrc:group:3202enrichment · scidb cntaxonomy-embedding@1.0.0title+keywords+description (72%)
concepts[field].local:field:computer-science-aimapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:economics-financemapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:medicine-healthmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
license_textsource · scidb cnconnector:scidb_cn@1.0.0
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title