Data · dataset · 2026
Benchmarking and process diagnostics of land models
Listed in National Center for Atmospheric Research
We propose a conceptual and theoretical foundation for information-based model benchmarking and process diagnostics that provides diagnostic insight into model performance and model realism.
Description
We benchmark against a bounded estimate of the information contained in model inputs to obtain a bounded estimate of information lost due to model error, and we perform process-level diagnostics by taking differences between modeled versus observed transfer entropy networks.
We use this methodology to reanalyze the recent Protocol for the Analysis of Land Surface Models (PALS) Land Surface Model Benchmarking Evaluation Project (PLUMBER) land model intercomparison project that includes the following models: CABLE, CH-TESSEL, COLA-SSiB, ISBA-SURFEX, JULES, Mosaic, Noah, and ORCHIDEE. We report that these models (i) use only roughly half of the information available from meteorological inputs about observed surface energy fluxes, (ii) do not use all information from meteorological inputs about long-term Budyko-type water balances, (iii) do not capture spatial heterogeneities in surface processes, and (iv) all suffer from similar patterns of process-level structural error.
Read the rest (2 more)
Because the PLUMBER intercomparison project did not report model parameter values, it is impossible to know whether process-level error patterns are due to model structural error or parameter error, although our proposed information-theoretic methodology could distinguish between these two issues if parameter values were reported. We conclude that there is room for significant improvement to the current generation of land models and their parameters.
We also suggest two simple guidelines to make future community-wide model evaluation and intercomparison experiments more informative.
Links
Get the data
- Publisher page n2t.org/ark:/85065/d71v5hx8 ↗
documentation · download · from data ucar edu
Where it is published
- data.ucar.edu /dataset/benchmarking-and-process-diagnostics-of-land-models ↗
National Center for Atmospheric Research dataset page
landing page · from data ucar edu
Catalogue records · 1
- CKAN API data.ucar.edu/api/3/action/package_show?id=66ab5052-f9df-41fd-b191-b3c2ffb4a… ↗
metadata API · from data ucar edu
Topics
- From keywords
- Earth & Environmental Science · Ocean & Atmospheric Science
- Inferred from text
- Computational modelling and simulation in earth sciences 80%
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| National Center for Atmospheric Research | 66ab5052-f9df-41fd-b191-b3c2ffb4ae63 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:field:370401 | enrichment · data ucar edu | taxonomy-embedding@1.1.0 | title+keywords+description (80%) |
| concepts[field].local:field:earth-environmental | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| created_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| description | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /notes |
| publication_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| title | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /title |
| updated_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 |