Identification

Title

Examining Variations in the Optimal Compression Level of Spatiotemporal Datasets Determined Using the Data Structural Similarity Index Measure (DSSIM)

Abstract

Lossy compression of climate model output is desperately needed to reduce the massive storage burden on research centers. Lossy compression must be applied carefully to avoid inadvertently aﬀecting any scientiﬁc analyses. At a minimum, the compressed datasets should not be visually different when compared with the original datasets. The DSSIM is a promising metric that is effective as classifying images as visually distinct or indistinct. Here we use the DSSIM to determine the optimal compression levels for climate datasets and then examine the behavior of the DSSIM applied to CESM-LENS data under multiple compression levels. We note that the DSSIM is not monotonic in the compression level and examine this behavior in more depth. We also obtain the optimal compression levels for time slices of each variable to get a feel for how these levels vary, and compute the optimal compression level for every variable. Finally, we look at how the optimal compression level obtained using the DSSIM is related to the file size of each compressed dataset.

Resource type

document

Resource locator

Unique resource identifier

code

http://n2t.net/ark:/85065/d78k7dj8

codeSpace

Dataset language

eng

Spatial reference system

code identifying the spatial reference system

Classification of spatial data and services

Topic category

geoscientificInformation

Keywords

Keyword set

keyword value

Text

originating controlled vocabulary

title

Resource Type

reference date

date type

publication

effective date

2016-01-01T00:00:00Z

Geographic location

West bounding longitude

East bounding longitude

North bounding latitude

South bounding latitude

Temporal reference

Temporal extent

Begin position

End position

Dataset reference date

date type

publication

effective date

2021-10-22T00:00:00Z

Frequency of update

Quality and validity

Lineage

Conformity

Data format

name of format

version of format

Constraints related to access and use

Constraint set

Use constraints

Limitations on public access

None

Responsible organisations

Responsible party

contact position

OpenSky Support

organisation name

UCAR/NCAR - Library

full postal address

PO Box 3000

Boulder

80307-3000

email address

opensky@ucar.edu

web address

http://opensky.ucar.edu/

name: homepage

responsible party role

pointOfContact

Metadata on metadata

Metadata point of contact