Table · dataset · 2026
<p>Summary of the synthetic training dataset.</p>
Listed in figshare
<div> <p>Background</p><p>Public synthetic datasets enable transparent model comparison but cannot establish performance in clinical populations.
Description
We asked how four fixed classifiers compare under one leakage-controlled validation framework on a large synthetic heart-disease competition dataset.</p> <p>Methods</p><p>The official training set contained 630,000 observations (44.83% outcome prevalence) and 13 predictors; the 270,000-row test set had no outcome labels.
L2-regularized logistic regression, HistGradientBoosting, CatBoost, and LightGBM were evaluated using identical stratified five-fold outer splits. Logistic-regression preprocessing was fitted within outer-training data, and early stopping used outer-training data only. The primary measure was pooled out-of-fold (OOF) AUROC; secondary measures were average precision, Brier score, calibration intercept and slope, fold variability, and train–validation optimism.
Read the rest (3 more)
Duplicate/overlap, identifier-only, and permuted-outcome controls assessed leakage.</p> <p>Results</p><p>Pooled OOF AUROC was 0.955443 for CatBoost, 0.955324 for LightGBM, 0.955066 for HistGradientBoosting, and 0.952874 for logistic regression. Corresponding average precision ranged from 0.945912 to 0.948828 and Brier scores from 0.081116 to 0.083518. Calibration intercepts ranged from −0.001299 to 0.002153 and slopes from 0.998896 to 1.004388.
Mean optimism was 0.000017–0.002686. No duplicated identifiers, duplicated feature profiles, or train–test feature-profile overlap were found; identifier-only AUROC was 0.500121 and mean permuted-outcome AUROC was 0.500615.</p> <p>Conclusions</p><p>All four models discriminated strongly and showed close internal calibration, while gradient-boosting models had only marginally higher AUROC than logistic regression. The principal contribution is a fully rerunnable, controlled benchmark rather than a novel algorithm or a clinically validated prediction model.
External performance in real clinical cohorts remains unknown.</p></div>
Links
Where it is published
- DOI doi.org/10.1371/journal.pone.0354304.t001 ↗
DOI / persistent id · from figshare com
Catalogue records · 1
- OAI-PMH record api.figshare.com/v2/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Af… ↗
metadata API · from figshare com
Topics
- From keywords
- Astronomy & Astrophysics · Biochemistry and cell biology · Cancer · Chemistry · Computer Science & AI · Earth & Environmental Science · Economics & Finance · Engineering · Genetics · Humanities · Infectious diseases · Life Sciences · Mathematics & Statistics · Medicine & Health · Ocean & Atmospheric Science · Social Science · Virology
Provenance · 1 source records, 22 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| figshare | oai:figshare.com:article/33958086 | 8 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · figshare com | connector:figshare_com@1.0.0 | |
| concepts[disease].local:disease:cancer | mapping · figshare com | vocabulary-mapper@1.0.0 | keywords['Cancer'] |
| concepts[field].anzsrc:field:310706 | mapping · figshare com | vocabulary-mapper@1.0.0 | keywords['Virology'] |
| concepts[field].anzsrc:field:320211 | mapping · figshare com | vocabulary-mapper@1.0.0 | keywords['Infectious Diseases'] |
| concepts[field].anzsrc:group:3101 | mapping · figshare com | vocabulary-mapper@1.0.0 | keywords['Cell Biology'] |
| concepts[field].anzsrc:group:3105 | mapping · figshare com | vocabulary-mapper@1.0.0 | keywords['Genetics'] |
| concepts[field].local:field:astronomy | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:chemistry | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:economics-finance | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:engineering | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:humanities | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:mathematics-statistics | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:social-science | mapping · figshare com | connector:figshare_com@1.0.0 | |
| description | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/description |
| license | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/rights |
| publication_date | source · figshare com | connector:figshare_com@1.0.0 | |
| title | source · figshare com | connector:figshare_com@1.0.0 | /metadata/dc/title |