Istvan Szunyogh

A local ensemble Kalman filter for atmospheric data assimilation

In this paper, we introduce a new, local formulation of the ensemble Kalman Filter approach for atmospheric data assimilation. Our scheme is based on the hypothesis that, when the Earths surface is divided up into local regions of moderate size, vectors of the forecast uncertainties in such regions tend to lie in a subspace of much lower dimension than that of the full atmospheric state vector of such a region. Ensemble Kalman Filters, in general, assume that the analysis resulting from the data assimilation lies in the same subspace as the expected forecast error. Under our hypothesis the dimension of this subspace is low. This implies that operations only on relatively low dimensional matrices are required. Thus, the data analysis is done locally in a manner allowing massively parallel computation to be exploited. The local analyses are then used to construct global states for advancement to the next forecast time. The method, its potential advantages, properties, and implementation requirements are illustrated by numerical experiments on the Lorenz-96 model. It is found that accurate analysis can be achieved at a cost which is very modest compared to that of a full global ensemble Kalman Filter.

Four-dimensional ensemble Kalman filtering

Ensemble Kalman filtering was developed as a way to assimilate observed data to track the current state in a computational model. In this paper we show that the ensemble approach makes possible an additional benefit: the timing of observations, whether they occur at the assimilation time or at some earlier or later time, can be effectively accounted for at low computational expense. In the case of linear dynamics, the technique is equivalent to instantaneously assimilating data as they are measured. The results of numerical tests of the technique on a simple model problem are shown.

A local ensemble transform Kalman filter data assimilation system for the NCEP global model

The accuracy and computational efficiency of a parallel computer implementation of the Local Ensemble Transform Kalman Filter (LETKF) data assimilation scheme on the model component of the 2004 version of the Global Forecast System (GFS) of the National Centers for Environmental Prediction (NCEP) is investigated. Numerical experiments are carried out at model resolution T62L28. All atmospheric observations that were operationally assimilated by NCEP in 2004, except for satellite radiances, are assimilated with the LETKF. The accuracy of the LETKF analyses is evaluated by comparing it to that of the Spectral Statistical Interpolation (SSI), which was the operational global data assimilation scheme of NCEP in 2004. For the selected set of observations, the LETKF analyses are more accurate than the SSI analyses in the Southern Hemisphere extratropics and are comparably accurate in the Northern Hemisphere extratropics and in the Tropics. The computationalwall-clock times achieved on a Beowulf cluster of 3.6 GHz Xeon processors make our implementation of the LETKF on the NCEP GFS a widely applicable analysis-forecast system, especially for research purposes. For instance, the generation of four daily analyses at the resolution of the NCAR-NCEP reanalysis (T62L28) for a full season (90 d), using 40 processors, takes less than 4 d of wall-clock time.

The North Pacific Experiment (NORPEX-98): Targeted Observations for Improved North American Weather Forecasts

Abstract The objectives and preliminary results of an interagency field program, the North Pacific Experiment (NORPEX), which took place between 14 January and 27 February 1998, are described. NORPEX represents an effort to directly address the issue of observational sparsity over the North Pacific basin, which is a major contributing factor in short-range (less than 4 days) forecast failures for land-falling Pacific winter-season storms that affect the United States, Canada, and Mexico. The special observations collected in NORPEX include approximately 700 targeted tropospheric soundings of temperature, wind, and moisture from Global Positioning System (GPS) dropsondes obtained in 38 storm reconnaissance missions using aircraft based primarily in Hawaii and Alaska. In addition, wind data were provided every 6 h over the entire North Pacific during NORPEX, using advanced and experimental techniques to extract information from multispectral geostationary satellite imagery. Preliminary results of NORPEX dat...

The Effect of Targeted Dropsonde Observations during the 1999 Winter Storm Reconnaissance Program

Abstract In this paper, the effects of targeted dropsonde observations on operational global numerical weather analyses and forecasts made at the National Centers for Environmental Prediction (NCEP) are evaluated. The data were collected during the 1999 Winter Storm Reconnaissance field program at locations that were found optimal by the ensemble transform technique for reducing specific forecast errors over the continental United States and Alaska. Two parallel analysis–forecast cycles are compared; one assimilates all operationally available data including those from the targeted dropsondes, whereas the other is identical except that it excludes all dropsonde data collected during the program. It was found that large analysis errors appear in areas of intense baroclinic energy conversion over the northeast Pacific and are strongly associated with errors in the first-guess field. The “signal,” defined by the difference between analysis–forecast cycles with and without the dropsonde data, propagates at an...

Propagation of the Effect of Targeted Observations: The 2000 Winter Storm Reconnaissance Program

Abstract The propagation of the effect of targeted observations in numerical weather forecasts is investigated, based on results from the 2000 Winter Storm Reconnaissance (WSR00) program. In this field program, nearly 300 dropsondes were released adaptively at selected locations over the northeast Pacific on 12 separate flight days with the aim of reducing the risk of major failures in severe winter storm forecasts over the United States. The data impact was assessed by analysis–forecast experiments carried out with the T62 horizontal resolution, 28-level version of the operational global Medium Range Forecast system of the National Centers for Environmental Prediction. In some cases, storms that reached the West Coast or Alaska were observed in an earlier phase of their development, while at other times the goal was to improve the prediction of storms that formed far downstream of the targeted region. Changes in the forecasts were the largest when landfalling systems were targeted and the baroclinic ener...

Assessing a local ensemble Kalman filter: perfect model experiments with the National Centers for Environmental Prediction global model

The accuracy and computational efficiency of the recently proposed local ensemble Kalman filter (LEKF) data assimilation scheme is investigated on a state-of-the-art operational numerical weather prediction model using simulated observations. The model selected for this purpose is the T62 horizontaland 28-level vertical-resolution version of the Global Forecast System (GFS) of the National Center for Environmental Prediction. The performance of the data assimilation system is assessed for different configurations of the LEKF scheme. It is shown that a modest size (40-member) ensemble is sufficient to track the evolution of the atmospheric state with high accuracy. For this ensemble size, the computational time per analysis is less than 9 min on a cluster of PCs. The analyses are extremely accurate in the mid-latitude storm track regions. The largest analysis errors, which are typically much smaller than the observational errors, occur where parametrized physical processes play important roles. Because these are also the regions where model errors are expected to be the largest, limitations of a real-data implementation of the ensemble-based Kalman filter may be easily mistaken for model errors. In light of these results, the importance of testing the ensemble-based Kalman filter data assimilation systems on simulated observations is stressed.

Local ensemble Kalman filtering in the presence of model bias

We modify the local ensemble Kalman filter (LEKF) to incorporate the effect of forecast model bias. The method is based on augmentation of the atmospheric state by estimates of the model bias, and we consider different ways of modeling (i.e. parameterizing) the model bias. We evaluate the effectiveness of the proposed augmented state ensemble Kalman filter through numerical experiments incorporating various model biases into the model of Lorenz and Emanuel. Our results highlight the critical role played by the selection of a good parameterization model for representing the form of the possible bias in the forecast model. In particular, we find that forecasts can be greatly improved provided that a good model parameterizing the model bias is used to augment the state in the Kalman filter.

Extracting Envelopes of Rossby Wave Packets

Abstract Packets of Rossby waves play an important role in the transfer of kinetic energy in the extratropics. The ability to locate, track, and detect changes in the envelope of these wave packets is vital to detecting baroclinic downstream development, tracking the impact of the analysis errors in numerical weather forecasts, and analyzing the forecast effects of targeted weather observations. In this note, it is argued that a well-known technique of digital signal processing, which is based on the Hilbert transform, should be used for extracting the envelope of atmospheric wave packets. This technique is robust, simple, and computationally inexpensive. The superiority of the proposed algorithm over the complex demodulation technique (the only technique previously used for this purpose in atmospheric studies) is demonstrated by examples. The skill of the proposed algorithm is also demonstrated by tracking wave packets in operational weather analyses from the National Centers for Environmental Prediction...

Mechanisms for the Development of Locally Low-Dimensional Atmospheric Dynamics

The complexity of atmospheric instabilities is investigated by a combination of numerical experiments and diagnostic tools that do not require the assumption of linear error dynamics. These tools include the well-established analysis of the local energetics of the atmospheric flow and the recently introduced ensemble dimension (E dimension). The E dimension is a local measure that varies in both space and time and quantifies the distribution of the variance between phase space directions for an ensemble of nonlinear model solutions over a geographically localized region. The E dimension is maximal, that is, equal to the number of ensemble members (k), when the variance is equally distributed between k phase space directions. The more unevenly distributed the variance, the lower the E dimension. Numerical experiments with the state-of-the-art operational Global Forecast System (GFS) of the National Centers for Environmental Prediction (NCEP) at a reduced resolution are carried out to investigate the spatiotemporal evolution of the E dimension. This evolution is characterized by an initial transient phase in which coherent regions of low dimensionality develop through a rapid local decay of the E dimension. The typical duration of the transient is between 12 and 48 h depending on the flow; after the initial transient, the E dimension gradually increases with time. The main goal of this study is to identify processes that contribute to transient local low-dimensional behavior. Case studies are presented to show that local baroclinic and barotropic instabilities, downstream development of upper-tropospheric wave packets, phase shifts of finite amplitude waves, anticyclonic wave breaking, and some combinations of these processes can all play crucial roles in lowering the E dimension. The practical implication of the results is that a wide range of synoptic-scale weather events may exist whose prediction can be significantly improved in the short and early medium range by enhancing the prediction of only a few local phase space directions. This potential is demonstrated by a reexamination of the targeted weather observations missions from the 2000 Winter Storm Reconnaissance (WSR00) program.