Constarium
← Search

Data · dataset · 2026

Benchmarking and process diagnostics of land models

Listed in National Center for Atmospheric Research

We propose a conceptual and theoretical foundation for information-based model benchmarking and process diagnostics that provides diagnostic insight into model performance and model realism.

Description

We benchmark against a bounded estimate of the information contained in model inputs to obtain a bounded estimate of information lost due to model error, and we perform process-level diagnostics by taking differences between modeled versus observed transfer entropy networks.

We use this methodology to reanalyze the recent Protocol for the Analysis of Land Surface Models (PALS) Land Surface Model Benchmarking Evaluation Project (PLUMBER) land model intercomparison project that includes the following models: CABLE, CH-TESSEL, COLA-SSiB, ISBA-SURFEX, JULES, Mosaic, Noah, and ORCHIDEE. We report that these models (i) use only roughly half of the information available from meteorological inputs about observed surface energy fluxes, (ii) do not use all information from meteorological inputs about long-term Budyko-type water balances, (iii) do not capture spatial heterogeneities in surface processes, and (iv) all suffer from similar patterns of process-level structural error.

Read the rest (2 more)

Because the PLUMBER intercomparison project did not report model parameter values, it is impossible to know whether process-level error patterns are due to model structural error or parameter error, although our proposed information-theoretic methodology could distinguish between these two issues if parameter values were reported. We conclude that there is room for significant improvement to the current generation of land models and their parameters.

We also suggest two simple guidelines to make future community-wide model evaluation and intercomparison experiments more informative.

Links

Get the data

Where it is published

Catalogue records · 1

Topics

Provenance · 1 source records, 8 field assertions
SourceKeyLast seenRaw
National Center for Atmospheric Research66ab5052-f9df-41fd-b191-b3c2ffb4ae6311 d agoJSON v1
FieldAssertionExtractorEvidence
concepts[field].anzsrc:field:370401enrichment · data ucar edutaxonomy-embedding@1.1.0title+keywords+description (80%)
concepts[field].local:field:earth-environmentalmapping · data ucar educonnector:data_ucar_edu@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · data ucar educonnector:data_ucar_edu@1.0.0
created_datesource · data ucar educonnector:data_ucar_edu@1.0.0
descriptionsource · data ucar educonnector:data_ucar_edu@1.0.0/notes
publication_datesource · data ucar educonnector:data_ucar_edu@1.0.0
titlesource · data ucar educonnector:data_ucar_edu@1.0.0/title
updated_datesource · data ucar educonnector:data_ucar_edu@1.0.0