Identification

Title

A Statistical Investigation of the CESM Ensemble Consistency Testing Framework

Abstract

Constant evolution and improvement of large scale climate simulation codes such as the Community Earth System Model (CESM) necessitate quality checks to verify the constitution of new climate simulations. The CESM Ensemble Consistency Test (CESM-ECT) was developed as a flexible but objective method for checking the statistical consistency between an accepted ensemble of climate simulations and a new simulation created with updated code or within a new computational infrastructure. CESM-ECT utilizes a testing framework based on the popular technique of Principal Component Analysis (PCA) to determine whether a set of new simulations is statistically distinguishable from the established ensemble of climate simulations. One shortcoming of PCA is that accurate estimation requires the computational expense of a large ensemble. In this work we begin with an exploratory analysis of the CESM climate simulation data as well as an overview of PCA. Then we develop certain diagnostic tools to evaluate the estimation within PCA with respect to the size of the ensemble. Finally we demonstrate the limitations of PCA for smaller ensemble sizes by showing poor performance according to our diagnostics as well as an increased false positive rate for both empirical and simulated data.

Resource type

document

Resource locator

Unique resource identifier

code

http://n2t.net/ark:/85065/d7sn0czx

codeSpace

Dataset language

eng

Spatial reference system

code identifying the spatial reference system

Classification of spatial data and services

Topic category

geoscientificInformation

Keywords

Keyword set

keyword value

Text

originating controlled vocabulary

title

Resource Type

reference date

date type

publication

effective date

2016-01-01T00:00:00Z

Keyword set

keyword value

EARTH SCIENCE SERVICES > DATA ANALYSIS AND VISUALIZATION > STATISTICAL APPLICATIONS

EARTH SCIENCE SERVICES > MODELS > COUPLED CLIMATE MODELS

originating controlled vocabulary

title

U.S. National Aeronautics and Space Administration Global Change Master Directory

reference date

date type

revision

effective date

2021-09-17

Geographic location

West bounding longitude

East bounding longitude

North bounding latitude

South bounding latitude

Temporal reference

Temporal extent

Begin position

End position

Dataset reference date

date type

publication

effective date

2018-12-27T00:00:00Z

Frequency of update

Quality and validity

Lineage

Conformity

Data format

name of format

version of format

Constraints related to access and use

Constraint set

Use constraints

Copyright Author(s). This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Limitations on public access

None

Responsible organisations

Responsible party

contact position

OpenSky Support

organisation name

UCAR/NCAR - Library

full postal address

PO Box 3000

Boulder

80307-3000

email address

opensky@ucar.edu

web address

http://opensky.ucar.edu/

name: homepage

responsible party role

pointOfContact

Metadata on metadata

Metadata point of contact

contact position

OpenSky Support

organisation name

UCAR/NCAR - Library

full postal address

PO Box 3000

Boulder

80307-3000

email address

opensky@ucar.edu

web address

http://opensky.ucar.edu/

name: homepage

responsible party role

pointOfContact

Metadata date

2023-08-18T18:06:52.541434

Metadata language

eng; USA