Data · dataset · 2011
Replication data for: The Separation Plot: A New Visual Method for Evaluating the Fit of Binary Models
Listed in Harvard Dataverse
We present a visual method for assessing the predictive power of models with binary outcomes.
Description
This technique allows the analyst to evaluate model fit based upon the models' ability to consistently match high-probability predictions to actual occurrences of the event of interest, and low-probability predictions to non-occurrences of the event of interest. Unlike existing methods for assessing predictive power for logit and probit models such as Percent Correctly Predicted statistics, Brier scores and the ROC plot, our ``separation plot" has the advantage of producing a visual display that is informative and easy to explain to a general audience, while also remaining insensitive to the often arbitrary probability thresholds that are used to distinguish between predicted events and non-events.
We demonstrate the effectiveness of this technique in building predictive models in a number of different areas of political research.
Links
Where it is published
- Dataverse dataset page dataverse.harvard.edu/dataset.xhtml?persistentId=doi%3A10.7910%2FDVN%2FY2VLEC ↗
landing page · from Harvard Dataverse
- DOI doi.org/10.7910/dvn/y2vlec ↗
DOI / persistent id · from Harvard Dataverse
Catalogue records · 1
- Dataverse API dataverse.harvard.edu/api/datasets/:persistentId/?persistentId=doi%3A10.7910%2FDVN%2… ↗
metadata API · from Harvard Dataverse
Topics
- Inferred from text
- Statistics 74%
Provenance · 1 source records, 7 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Harvard Dataverse | doi:10.7910/DVN/Y2VLEC | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:group:4905 | enrichment · Harvard Dataverse | taxonomy-embedding@1.1.0 | title+keywords+description (74%) |
| created_date | source · Harvard Dataverse | connector:dataverse@1.0.0 | |
| description | source · Harvard Dataverse | connector:dataverse@1.0.0 | /description |
| publication_date | source · Harvard Dataverse | connector:dataverse@1.0.0 | |
| title | source · Harvard Dataverse | connector:dataverse@1.0.0 | /name |
| updated_date | source · Harvard Dataverse | connector:dataverse@1.0.0 | |
| version_label | source · Harvard Dataverse | connector:dataverse@1.0.0 |