Constarium
← Search

Table · dataset · 2026

<p>Summary of the synthetic training dataset.</p>

Listed in figshare

<div> <p>Background</p><p>Public synthetic datasets enable transparent model comparison but cannot establish performance in clinical populations.

Description

We asked how four fixed classifiers compare under one leakage-controlled validation framework on a large synthetic heart-disease competition dataset.</p> <p>Methods</p><p>The official training set contained 630,000 observations (44.83% outcome prevalence) and 13 predictors; the 270,000-row test set had no outcome labels.

L2-regularized logistic regression, HistGradientBoosting, CatBoost, and LightGBM were evaluated using identical stratified five-fold outer splits. Logistic-regression preprocessing was fitted within outer-training data, and early stopping used outer-training data only. The primary measure was pooled out-of-fold (OOF) AUROC; secondary measures were average precision, Brier score, calibration intercept and slope, fold variability, and train–validation optimism.

Read the rest (3 more)

Duplicate/overlap, identifier-only, and permuted-outcome controls assessed leakage.</p> <p>Results</p><p>Pooled OOF AUROC was 0.955443 for CatBoost, 0.955324 for LightGBM, 0.955066 for HistGradientBoosting, and 0.952874 for logistic regression. Corresponding average precision ranged from 0.945912 to 0.948828 and Brier scores from 0.081116 to 0.083518. Calibration intercepts ranged from −0.001299 to 0.002153 and slopes from 0.998896 to 1.004388.

Mean optimism was 0.000017–0.002686. No duplicated identifiers, duplicated feature profiles, or train–test feature-profile overlap were found; identifier-only AUROC was 0.500121 and mean permuted-outcome AUROC was 0.500615.</p> <p>Conclusions</p><p>All four models discriminated strongly and showed close internal calibration, while gradient-boosting models had only marginally higher AUROC than logistic regression. The principal contribution is a fully rerunnable, controlled benchmark rather than a novel algorithm or a clinically validated prediction model.

External performance in real clinical cohorts remains unknown.</p></div>

Links

Where it is published

Catalogue records · 1

Topics

Provenance · 1 source records, 22 field assertions
SourceKeyLast seenRaw
figshareoai:figshare.com:article/339580868 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · figshare comconnector:figshare_com@1.0.0
concepts[disease].local:disease:cancermapping · figshare comvocabulary-mapper@1.0.0keywords['Cancer']
concepts[field].anzsrc:field:310706mapping · figshare comvocabulary-mapper@1.0.0keywords['Virology']
concepts[field].anzsrc:field:320211mapping · figshare comvocabulary-mapper@1.0.0keywords['Infectious Diseases']
concepts[field].anzsrc:group:3101mapping · figshare comvocabulary-mapper@1.0.0keywords['Cell Biology']
concepts[field].anzsrc:group:3105mapping · figshare comvocabulary-mapper@1.0.0keywords['Genetics']
concepts[field].local:field:astronomymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:humanitiesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:life-sciencesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:mathematics-statisticsmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:medicine-healthmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:social-sciencemapping · figshare comconnector:figshare_com@1.0.0
descriptionsource · figshare comconnector:figshare_com@1.0.0/metadata/dc/description
licensesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/rights
publication_datesource · figshare comconnector:figshare_com@1.0.0
titlesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/title