Data · dataset · 2026
A Statistical Approach to Obtaining a Data Structural Similarity Index Cutoff Threshold
Listed in National Center for Atmospheric Research
Huge climate simulations such as the Community Earth System Model Large Ensemble (CESM-LE) output massive amounts of data, and switching from lossless to lossy compression of this data is inevitable.
Description
Applying lossy compression to climate data requires a guarantee that scientiï¬c conclusions will not be aï¬ected by the compression process. One way to check if a scientist's conclusions will be altered is by assessing if the data has been visually altered in any way.
To that extent, the Data Structural Similarity Index Measure (DSSIM) is designed to test the visual similarity between two images. It is based on the well-known Structural Similarity Index Measure (SSIM), but has been modiï¬ed to fit our application. The DSSIM is computed on two datasets instead of two images.
Read the rest (2 more)
This makes the measure invariant to the plotting parameters. Additionally, the DSSIM is much more efficient to compute on a floating-point dataset than the SSIM. A user study in a previous work determined an appropriate SSIM threshold, above which images are highly likely to be visually indistinguishable.
In this work, we use the results of the previous study and statistical techniques to translate the SSIM threshold to an appropriate cutoff threshold for the DSSIM. We find the appropriate threshold by minimizing the pass/fail classification difference between images classiï¬ed using the DSSIM and the previously acquired SSIM threshold. This threshold results in agreement between the image classification results using either metric in more than 92% of cases.
Links
Get the data
- Publisher page n2t.org/ark:/85065/d7gh9nd9 ↗
documentation · download · from data ucar edu
Where it is published
- data.ucar.edu /dataset/a-statistical-approach-to-obtaining-a-data-structural-… ↗
National Center for Atmospheric Research dataset page
landing page · from data ucar edu
Catalogue records · 1
- CKAN API data.ucar.edu/api/3/action/package_show?id=1057e5c9-6847-4447-96c1-725bf1748… ↗
metadata API · from data ucar edu
Topics
- From keywords
- Earth & Environmental Science · Ocean & Atmospheric Science
- Inferred from text
- Image 75%
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| National Center for Atmospheric Research | 1057e5c9-6847-4447-96c1-725bf1748b39 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].local:field:earth-environmental | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[modality].local:modality:image | enrichment · data ucar edu | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| description | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /notes |
| publication_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| title | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /title |
| updated_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 |