Data · dataset · 2026
Statistical Analysis of Compressed Climate Data
Listed in National Center for Atmospheric Research
[Note: this Technical Note was updated on 2020-08-17 per the authors' request to correct an error.
Description
See the description of the change on page two of the document's front matter.] The data storage burden resulting from large climate model experiments only continues to grow. Lossy data compression methods are required to alleviate this burden, but lossy methods introduce the possibility that key climate variable fields could be altered to the point of affecting scientific conclusions.
It is therefore important to develop a detailed understanding of how compressed climate model output differs from the original for different compression algorithms and compression rates. In this work, we evaluate the effects of two leading compression algorithms, sz and zfp, on daily average and monthly maximum temperature data, and daily average precipitation rate data, from a historical run of CESM1 CAM5.2. While both algorithms show promising fidelity with the original model output, detectable artifacts are introduced even at relatively low error tolerances.
Read the rest (1 more)
Examples for temperature data include biases in temperature gradient fields, temporal autocorrelation, and seasonal cycles; precipitation data show, for example, biases in the number of rainy days. We highlight the need for evaluation methods that are sensitive to errors at different spatiotemporal scales and specific to the particular climate variable of interest.
Links
Get the data
- Publisher page n2t.org/ark:/85065/d7p84fqd ↗
documentation · download · from data ucar edu
Where it is published
- data.ucar.edu /dataset/statistical-analysis-of-compressed-climate-data ↗
National Center for Atmospheric Research dataset page
landing page · from data ucar edu
Catalogue records · 1
- CKAN API data.ucar.edu/api/3/action/package_show?id=d5c2a93d-fb0f-4cdb-8bfc-5b50be138… ↗
metadata API · from data ucar edu
Topics
- Inferred from text
- Climate model simulation 65%
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| National Center for Atmospheric Research | d5c2a93d-fb0f-4cdb-8bfc-5b50be138b58 | 10 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].local:field:earth-environmental | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[field].local:field:mathematics-statistics | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[method].local:method:climate-model | enrichment · data ucar edu | keyword-concept-rules@1.0.0 | title+description (65%) |
| created_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| description | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /notes |
| publication_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| title | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /title |
| updated_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 |