Data · dataset · 2026
epiforecasts/scoringutils
Listed in LSHTM Data Compass
The scoringutils package provides a collection of metrics and proper scoring rules and aims to make it simple to score probabilistic forecasts against the true observed values.
Description
The scoringutils package offers convenient automated forecast evaluation in a data.table format (using the function score()), but also provides experienced users with a set of reliable lower-level scoring metrics operating on vectors/matriced they can build upon in other applications.
In addition it implements a wide range of flexible plots designed to cover many use cases. Where available scoringutils depends on functionality from scoringRules which provides a comprehensive collection of proper scoring rules for predictive probability distributions represented as sample or parametric distributions. For some forecast types, such as quantile forecasts, scoringutils also implements additional metrics for evaluating forecasts.
Read the rest (2 more)
On top of providing an interface to the proper scoring rules implemented in scoringRules and natively, scoringutils also offers utilities for summarising and visualising forecasts and scores, and to obtain relative scores between models which may be useful for non-overlapping forecasts and forecasts across scales. Predictions can be handled in various formats: scoringutils can handle probabilistic forecasts in either a sample based or a quantile based format.
For more detail on the expected input formats please see below. True values can be integer, continuous or binary, and appropriate scores for each of these value types are selected automatically.
Links
Where it is published
- DOI doi.org/10.5281/zenodo.4618017 ↗
DOI / persistent id · from lshtm ac uk
Catalogue records · 1
- OAI-PMH record datacompass.lshtm.ac.uk/cgi/oai2?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3… ↗
metadata API · from lshtm ac uk
Topics
- From keywords
- Earth & Environmental Science · Humanities · Life Sciences · Medicine & Health · Social Science
- Inferred from text
- Tabular 65%
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| LSHTM Data Compass | oai:datacompass.lshtm.ac.uk:2759 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].local:field:earth-environmental | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[field].local:field:humanities | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[field].local:field:social-science | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[modality].local:modality:tabular | enrichment · lshtm ac uk | keyword-concept-rules@1.0.0 | title+description (65%) |
| description | source · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | /metadata/dc/description |
| publication_date | source · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| title | source · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | /metadata/dc/title |