← Search

Data · dataset · 2026

AgenticGenomics: pharmacogenomics benchmark dataset for "Trustworthy agentic genomics through versioned skill libraries"

Listed in LSHTM Data Compass

AgenticGenomics benchmark dataset.

Description

Controlled three-arm comparison of nine frontier large language models on pharmacogenomic interpretation: Claude Opus 4, Claude Sonnet 4, GPT-5.2, GPT-4.1, o3, o4-mini, Gemini 2.5 Flash, DeepSeek V3 and Mistral Large 2, evaluated on 110 CPIC Level A cases across three population contexts (European, admixed Latin American, East African) under three conditions (free-prompted; retrieval-augmented from the CPIC guideline corpus; constrained by a versioned SKILL.md-format specification executed as a contract), three replicates per cell, 26,730 evaluations.

The archive contains raw model responses, baseline and clinical-equivalence rescorer outputs, the locked merged three-arm dataset (26,730 rows), the forward and reverse adversarial scrambled-specification experiments, the (gene, drug)-keyed chunking control, the drug-recommendation regression classification, and figure-input tables. Records are scored on phenotype identification (A1), drug recommendation (A2) and lethal-class safety action (A3).

Read the rest (1 more)

All data derive from public CPIC Level A guidelines and PharmGKB annotations; genotypes are synthetic canonical cases; no patient data and no new sequencing data are included. Analysis code: github.com/manuelcorpas/24-AGENTIC-PGX-BENCHMARK (commit dc2c849e). Companion to the Perspective "Agentic Genomics: From Pipeline Automation to Autonomous Validation".

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Pharmacogenomics 81% · Sequencing 75%
Provenance · 1 source records, 10 field assertions
SourceKeyLast seenRaw
LSHTM Data Compassoai:datacompass.lshtm.ac.uk:522412 d agoJSON v1
FieldAssertionExtractorEvidence
concepts[field].anzsrc:field:321406enrichment · lshtm ac uktaxonomy-embedding@1.0.0title+keywords+description (81%)
concepts[field].local:field:earth-environmentalmapping · lshtm ac ukconnector:lshtm_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · lshtm ac ukconnector:lshtm_ac_uk@1.0.0
concepts[field].local:field:life-sciencesmapping · lshtm ac ukconnector:lshtm_ac_uk@1.0.0
concepts[field].local:field:medicine-healthmapping · lshtm ac ukconnector:lshtm_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · lshtm ac ukconnector:lshtm_ac_uk@1.0.0
concepts[modality].local:modality:sequencingenrichment · lshtm ac ukkeyword-concept-rules@1.0.0title+description (75%)
descriptionsource · lshtm ac ukconnector:lshtm_ac_uk@1.0.0/metadata/dc/description
publication_datesource · lshtm ac ukconnector:lshtm_ac_uk@1.0.0
titlesource · lshtm ac ukconnector:lshtm_ac_uk@1.0.0/metadata/dc/title