Sheri Mickelson

A methodology for evaluating the impact of data compression on climate simulation data

High-resolution climate simulations require tremendous computing resources and can generate massive datasets. At present, preserving the data from these simulations consumes vast storage resources at institutions such as the National Center for Atmospheric Research (NCAR). The historical data generation trends are economically unsustainable, and storage resources are already beginning to limit science objectives. To mitigate this problem, we investigate the use of data compression techniques on climate simulation data from the Community Earth System Model. Ultimately, to convince climate scientists to compress their simulation data, we must be able to demonstrate that the reconstructed data reveals the same mean climate as the original data, and this paper is a first step toward that goal. To that end, we develop an approach for verifying the climate data and use it to evaluate several compression algorithms. We find that the diversity of the climate data requires the individual treatment of variables, and, in doing so, the reconstructed data can fall within the natural variability of the system, while achieving compression rates of up to 5:1.

Towards Characterizing the Variability of Statistically Consistent Community Earth System Model Simulations

Abstract Large, complex codes such as earth system models are in a constant state of development, requiring frequent software quality assurance. The recently developed Community Earth System Model (CESM) Ensemble Consistency Test (CESM-ECT) provides an objective measure of statistical consistency for new CESM simulation runs, which has greatly facilitated error detection and rapid feedback for model users and developers. CESM-ECT determines consistency based on an ensemble of simulations that represent the same earth system model. Its statistical distribution embodies the natural variability of the model. Clearly the composition of the employed ensemble is critical to CESM-ECTs effectiveness. In this work we examine whether the composition of the CESM-ECT ensemble is adequate for characterizing the variability of a consistent climate. To this end, we introduce minimal code changes into CESM that should pass the CESM-ECT, and we evaluate the composition of the CESM-ECT ensemble in this context. We suggest an improved ensemble composition that better captures the accepted variability induced by code changes, compiler changes, and optimizations, thus more precisely facilitating the detection of errors in the CESM hardware or software stack as well as enabling more in-depth code optimization and the adoption of new technologies.

KGEN: A Python tool for automated Fortran kernel generation and verification

Abstract Computational kernels, which are small pieces of software that selectively capture the characteristics of larger applications, have been used successfully for decades. Kernels allow for the testing of a compilers ability to optimize code, performance of future hardware and reproducing compiler bugs. Unfortunately they can be rather time consuming to create and do not always accurately represent the full complexity of large scientific applications. Furthermore, expert knowledge is often required to create such kernels. In this paper, we present a Python-based tool that greatly simplifies the generation of computational kernels from Fortran based applications. Our tool automatically extracts partial source code of a larger Fortran application into a stand-alone executable kernel. Additionally, our tool also generates state data necessary for proper execution and verification of the extracted kernel. We have utilized our tool to extract more than thirty computational kernels from a million-line climate simulation model. Our extracted kernels have been used for a variety of purposes including: code modernization, identification of limitations in compiler optimizations, numerical algorithm debugging, compiler bug reporting, and for procurement benchmarking.

CESM1(WACCM) Stratospheric Aerosol Geoengineering Large Ensemble (GLENS) Project

This paper describes the Stratospheric Aerosol Geoengineering Large Ensemble (GLENS) project, which promotes the use of a unique model dataset, performed with the Community Earth System Model, with the Whole Atmosphere Community Climate Model as its atmospheric component [CESM1(WACCM)], to investigate global and regional impacts of geoengineering. The performed simulations were designed to achieve multiple simultaneous climate goals, by strategically placing sulfur injections at four different locations in the stratosphere, unlike many earlier studies that targeted globally averaged surface temperature by placing injections in regions at or around the equator. This advanced approach reduces some of the previously found adverse effects of stratospheric aerosol geoengineering, including uneven cooling between the poles and the equator and shifts in tropical precipitation. The 20-member ensemble increases the ability to distinguish between forced changes and changes due to climate variability in global and regional climate variables in the coupled atmosphere, land, sea ice, and ocean system. We invite the broader community to perform in-depth analyses of climate-related impacts and to identify processes that lead to changes in the climate system as the result of a strategic application of stratospheric aerosol geoengineering.

A new parallel python tool for the standardization of earth system model data

We have developed a new parallel Python tool for the standardization of Earth System Model (ESM) data for publication as part of Model Intercomparison Projects (MIPs). It was specifically designed to aid Community Earth System Model (CESM) scientists at the National Center for Atmospheric Research (NCAR) in preparation for the Coupled Model Intercomparison Project, Phase 6 (CMIP6), expected to start in early 2017. However, the tool is general to any and all MIPs and ESMs. The tool is implemented with MPI parallelism using mpi4py, and it performs the data standardization computation with a directed acyclic graph (DAG) data structure capable of streaming data from ESM input data to standardized output files. In this paper, we describe the tool, its design and testing.