Andrew Schepen

Evidence for Using Lagged Climate Indices to Forecast Australian Seasonal Rainfall

AbstractLagged oceanic and atmospheric climate indices are potentially useful predictors of seasonal rainfall totals. A rigorous Bayesian joint probability modeling approach is applied to find the cross-validation predictive densities of gridded Australian seasonal rainfall totals using lagged climate indices as predictors over the period of 1950–2009. The evidence supporting the use of each climate index as a predictor of seasonal rainfall is quantified by the pseudo-Bayes factor based on cross-validation predictive densities. The evidence strongly supports the use of climate indices from the Pacific region with weaker, but positive, evidence for the use of climate indices from the Indian region and the extratropical region. The spatial structure and seasonal variation of the evidence for each climate index is mapped and compared. Spatially, the strongest supporting evidence is found for forecasting in northern and eastern Australia. Seasonally, the strongest evidence is found from August–October to Nove...

Merging Seasonal Rainfall Forecasts from Multiple Statistical Models through Bayesian Model Averaging

AbstractMerging forecasts from multiple models has the potential to combine the strengths of individual models and to better represent forecast uncertainty than the use of a single model. This study develops a Bayesian model averaging (BMA) method for merging forecasts from multiple models, giving greater weights to better performing models. The study aims for a BMA method that is capable of producing relatively stable weights in the presence of significant sampling variability, leading to robust forecasts for future events. The BMA method is applied to merge forecasts from multiple statistical models for seasonal rainfall forecasts over Australia using climate indices as predictors. It is shown that the fully merged forecasts effectively combine the best skills of the models to maximize the spatial coverage of positive skill. Overall, the skill is low for the first half of the year but more positive for the second half of the year. Models in the Pacific group contribute the most skill, and models in the ...

Seasonal Forecasts of Australian Rainfall through Calibration and Bridging of Coupled GCM Outputs

AbstractCoupled general circulation models (GCMs) are increasingly being used to forecast seasonal rainfall, but forecast skill is still low for many regions. GCM forecasts suffer from systematic biases, and forecast probabilities derived from ensemble members are often statistically unreliable. Hence, it is necessary to postprocess GCM forecasts to improve skill and statistical reliability. In this study, the authors compare three methods of statistically postprocessing GCM output—calibration, bridging, and a combination of calibration and bridging—as ways to treat these problems and make use of multiple GCM outputs to increase the skill of Australian seasonal rainfall forecasts. Three calibration models are established using ensemble mean rainfall from three variants of the Predictive Ocean Atmosphere Model for Australia (POAMA) version M2.4 as predictors. Six bridging models are established using POAMA forecasts of seasonal climate indices as predictors. The calibration and bridging forecasts are merge...

Reliable long‐range ensemble streamflow forecasts: Combining calibrated climate forecasts with a conceptual runoff model and a staged error model

We present a new streamflow forecasting system called forecast guided stochastic scenarios (FoGSS). FoGSS makes use of ensemble seasonal precipitation forecasts from a coupled ocean-atmosphere general circulation model (CGCM). The CGCM forecasts are post-processed with the method of calibration, bridging and merging (CBaM) to produce ensemble precipitation forecasts over river catchments. CBaM corrects biases and removes noise from the CGCM forecasts, and produces highly reliable ensemble precipitation forecasts. The post-processed CGCM forecasts are used to force the Wapaba monthly rainfall-runoff model. Uncertainty in the hydrological modelling is accounted for with a 3-stage error model. Stage 1 applies the log-sinh transformation to normalize residuals and homogenize their variance; Stage 2 applies a conditional bias-correction to correct biases and help remove negative forecast skill; Stage 3 applies an autoregressive model to improve forecast accuracy at short lead-times and propagate uncertainty through the forecast. FoGSS generates ensemble forecasts in the form of time series for the coming 12-months. In a case study of two catchments, FoGSS produces reliable forecasts at all lead-times. Forecast skill with respect to climatology is evident to lead-times of about 3 months. At longer lead-times, forecast skill approximates that of climatology forecasts; that is, forecasts become like stochastic scenarios. Because forecast skill is virtually never negative at long lead-times, forecasts of accumulated volumes can be skillful. Forecasts of accumulated 12-month streamflow volumes are significantly skillful in several instances, and ensembles of accumulated volumes are reliable. We conclude that FoGSS forecasts could be highly useful to water managers. This article is protected by copyright. All rights reserved.

How Suitable is Quantile Mapping For Postprocessing GCM Precipitation Forecasts

AbstractGCMs are used by many national weather services to produce seasonal outlooks of atmospheric and oceanic conditions and fluxes. Postprocessing is often a necessary step before GCM forecasts can be applied in practice. Quantile mapping (QM) is rapidly becoming the method of choice by operational agencies to postprocess raw GCM outputs. The authors investigate whether QM is appropriate for this task. Ensemble forecast postprocessing methods should aim to 1) correct bias, 2) ensure forecasts are reliable in ensemble spread, and 3) guarantee forecasts are at least as skillful as climatology, a property called “coherence.” This study evaluates the effectiveness of QM in achieving these aims by applying it to precipitation forecasts from the POAMA model. It is shown that while QM is highly effective in correcting bias, it cannot ensure reliability in forecast ensemble spread or guarantee coherence. This is because QM ignores the correlation between raw ensemble forecasts and observations. When raw foreca...

Model averaging methods to merge operational statistical and dynamic seasonal streamflow forecasts in Australia

The Australian Bureau of Meteorology produces statistical and dynamic seasonal streamflow forecasts. The statistical and dynamic forecasts are similarly reliable in ensemble spread; however, skill varies by catchment and season. Therefore, it may be possible to optimize forecasting skill by weighting and merging statistical and dynamic forecasts. Two model averaging methods are evaluated for merging forecasts for 12 locations. The first method, Bayesian model averaging (BMA), applies averaging to forecast probability densities (and thus cumulative probabilities) for a given forecast variable value. The second method, quantile model averaging (QMA), applies averaging to forecast variable values (quantiles) for a given cumulative probability (quantile fraction). BMA and QMA are found to perform similarly in terms of overall skill scores and reliability in ensemble spread. Both methods improve forecast skill across catchments and seasons. However, when both the statistical and dynamical forecasting approaches are skillful but produce, on special occasions, very different event forecasts, the BMA merged forecasts for these events can have unusually wide and bimodal distributions. In contrast, the distributions of the QMA merged forecasts for these events are narrower, unimodal and generally more smoothly shaped, and are potentially more easily communicated to and interpreted by the forecast users. Such special occasions are found to be rare. However, every forecast counts in an operational service, and therefore the occasional contrast in merged forecasts between the two methods may be more significant than the indifference shown by the overall skill and reliability performance.

Toward Accurate and Reliable Forecasts of Australian Seasonal Rainfall by Calibrating and Merging Multiple Coupled GCMs

AbstractThe majority of international climate modeling centers now produce seasonal rainfall forecasts from coupled general circulation models (GCMs). Seasonal rainfall forecasting is highly challenging, and GCM forecast accuracy is still poor for many regions and seasons. Additionally, forecast uncertainty tends to be underestimated meaning that forecast probabilities are statistically unreliable. A common strategy employed to improve the overall accuracy and reliability of GCM forecasts is to merge forecasts from multiple models into a multimodel ensemble (MME). The most widely used technique is to simply pool all of the forecast ensemble members from multiple GCMs into what is known as a superensemble. In Australia, seasonal rainfall forecasts are produced using the Predictive Ocean–Atmosphere Model for Australia (POAMA). In this paper, the authors demonstrate that mean corrected superensembles formed by merging forecasts from POAMA with those from three international models in the ENSEMBLES dataset re...

Does improved SSTA prediction ensure better seasonal rainfall forecasts

Seasonal rainfall forecasts in Australia are issued based on concurrent sea surface temperature anomalies (SSTAs) using a Bayesian model averaging (BMA) approach. The SSTA fields are derived from the Predictive Ocean-Atmosphere Model for Australia (POAMA) initialized in the preceding season. This study investigates the merits of the rainfall forecasted using POAMA SSTAs in contrast to that forecasted using a multimodel combination of SSTAs derived using five existing models. In addition, seasonal rainfall forecasts derived from multimodel and POAMA SSTA fields are subsequently combined to obtain a single weighted forecast over Australia. These three forecasts are compared against “idealized” forecasts where observed SSTAs are used instead of those predicted. The results indicate that while seasonal rainfall forecasts derived using multimodel-based SSTA indices offer improvements in selected seasons over a majority of grid cells in comparison to the case where a single SSTA model is used in two seasons, these improvements are not as significant as the improvements in the SSTA field that drive the rainfall forecasting model. The forecasts derived from the combination of multimodel and POAMA SSTA indices forecasts are found to offer greater improvements over the multimodel or the POAMA forecasts for a majority of grid cells in all seasons. It is also observed that these combined forecasts are touching the upper limits of forecastability, which are reached when observed SSTAs are used to forecast the rainfall. This suggests that further improvements in rainfall forecasting are only possible through the use of an improved forecasting algorithm, and not the driver (SSTA) information used in the current study.

Calibration, Bridging, and Merging to Improve GCM Seasonal Temperature Forecasts in Australia

AbstractThere are a number of challenges that must be overcome if GCM forecasts are to be widely adopted in climate-sensitive industries such as agriculture and water management. GCM outputs are frequently biased relative to observations and their ensembles are unreliable in conveying uncertainty through appropriate spread. The calibration, bridging, and merging (CBaM) method has been shown to be an effective tool for postprocessing GCM rainfall forecasts to improve ensemble forecast attributes. In this study, CBaM is modified and extended to postprocess seasonal minimum and maximum temperature forecasts from the POAMA GCM in Australia. Calibration is postprocessing GCM forecasts using a statistical model. Bridging is producing additional forecasts using statistical models that have other GCM output variables (e.g., SST) as predictors. It is demonstrated that merging calibration and bridging forecasts through CBaM effectively improves the skill of POAMA seasonal minimum and maximum temperature forecasts f...

Application to Post-processing of Meteorological Seasonal Forecasting

In contrast to deterministic forecasts, ensemble forecasts are a multiple forecasts of the same events. The ensemble forecasts are generated by perturbing uncertain factors such as model forcings, initial conditions, and/or model physics.