Constarium
← Search

Data · dataset · 2026

A Statistical Approach to Obtaining a Data Structural Similarity Index Cutoff Threshold

Listed in National Center for Atmospheric Research

Huge climate simulations such as the Community Earth System Model Large Ensemble (CESM-LE) output massive amounts of data, and switching from lossless to lossy compression of this data is inevitable.

Description

Applying lossy compression to climate data requires a guarantee that scientific conclusions will not be affected by the compression process. One way to check if a scientist's conclusions will be altered is by assessing if the data has been visually altered in any way.

To that extent, the Data Structural Similarity Index Measure (DSSIM) is designed to test the visual similarity between two images. It is based on the well-known Structural Similarity Index Measure (SSIM), but has been modified to fit our application. The DSSIM is computed on two datasets instead of two images.

Read the rest (2 more)

This makes the measure invariant to the plotting parameters. Additionally, the DSSIM is much more efficient to compute on a floating-point dataset than the SSIM. A user study in a previous work determined an appropriate SSIM threshold, above which images are highly likely to be visually indistinguishable.

In this work, we use the results of the previous study and statistical techniques to translate the SSIM threshold to an appropriate cutoff threshold for the DSSIM. We find the appropriate threshold by minimizing the pass/fail classification difference between images classified using the DSSIM and the previously acquired SSIM threshold. This threshold results in agreement between the image classification results using either metric in more than 92% of cases.

Links

Get the data

Where it is published

Catalogue records · 1

Topics

Inferred from text
Image 75%
Provenance · 1 source records, 8 field assertions
SourceKeyLast seenRaw
National Center for Atmospheric Research1057e5c9-6847-4447-96c1-725bf1748b3911 d agoJSON v1
FieldAssertionExtractorEvidence
concepts[field].local:field:earth-environmentalmapping · data ucar educonnector:data_ucar_edu@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · data ucar educonnector:data_ucar_edu@1.0.0
concepts[modality].local:modality:imageenrichment · data ucar edukeyword-concept-rules@1.0.0title+description (75%)
created_datesource · data ucar educonnector:data_ucar_edu@1.0.0
descriptionsource · data ucar educonnector:data_ucar_edu@1.0.0/notes
publication_datesource · data ucar educonnector:data_ucar_edu@1.0.0
titlesource · data ucar educonnector:data_ucar_edu@1.0.0/title
updated_datesource · data ucar educonnector:data_ucar_edu@1.0.0