Hoshin V. Gupta

Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information

Several contributions to the hydrological literature have brought into question the continued usefulness of the classical paradigm for hydrologic model calibration. With the growing popularity of sophisticated “physically based” watershed models (e.g., land-surface hydrology and hydrochemical models) the complexity of the calibration problem has been multiplied many fold. We disagree with the seemingly widespread conviction that the model calibration problem will simply disappear with the availability of more and better field measurements. This paper suggests that the emergence of a new and more powerful model calibration paradigm must include recognition of the inherent multiobjective nature of the problem and must explicitly recognize the role of model error. The results of our preliminary studies are presented. Through an illustrative case study we show that the multiobjective approach is not only practical and relatively simple to implement but can also provide useful information about the limitations of a model.

Artificial Neural Network Modeling of the Rainfall-Runoff Process

An artificial neural network (ANN) is a flexible mathematical structure which is capable of identifying complex nonlinear relationships between input and output data sets. ANN models have been found useful and efficient, particularly in problems for which the characteristics of the processes are difficult to describe using physical equations. This study presents a new procedure (entitled linear least squares simplex, or LLSSIM) for identifying the structure and parameters of three-layer feed forward ANN models and demonstrates the potential of such models for simulating the nonlinear hydrologic behavior of watersheds. The nonlinear ANN model approach is shown to provide a better representation of the rainfall-runoff relationship of the medium-size Leaf River basin near Collins, Mississippi, than the linear ARMAX (autoregressive moving average with exogenous inputs) time series approach or the conceptual SAC-SMA (Sacramento soil moisture accounting) model. Because the ANN approach presented here does not provide models that have physically realistic components and parameters, it is by no means a substitute for conceptual watershed modeling. However, the ANN approach does provide a viable and effective alternative to the ARMAX time series approach for developing input-output simulation and forecasting models in situations that do not require modeling of the internal structure of the watershed.

A shuffled complex evolution metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters

Author(s): Vrugt, JA; Gupta, HV; Bouten, W; Sorooshian, S | Abstract: Markov Chain Monte Carlo (MCMC) methods have become increasingly popular for estimating the posterior probability distribution of parameters in hydrologic models. However, MCMC methods require the a priori definition of a proposal or sampling distribution, which determines the explorative capabilities and efficiency of the sampler and therefore the statistical properties of the Markov Chain and its rate of convergence. In this paper we present an MCMC sampler entitled the Shuffled Complex Evolution Metropolis algorithm (SCEM-UA), which is well suited to infer the posterior distribution of hydrologic model parameters. The SCEM-UA algorithm is a modified version of the original SCE-UA global optimization algorithm developed by Duan et al. [1992]. The SCEM-UA algorithm operates by merging the strengths of the Metropolis algorithm, controlled random search, competitive evolution, and complex shuffling in order to continuously update the proposal distribution and evolve the sampler to the posterior target distribution. Three case studies demonstrate that the adaptive capability of the SCEM-UA algorithm significantly reduces the number of model simulations needed to infer the posterior distribution of the parameters when compared with the traditional Metropolis-Hastings samplers.

Multi-objective global optimization for hydrologic models

The development of automated (computer-based) calibration methods has focused mainly on the selection of a single-objective measure of the distance between the model-simulated output and the data and the selection of an automatic optimization algorithm to search for the parameter values which minimize that distance. However, practical experience with model calibration suggests that no single-objective function is adequate to measure the ways in which the model fails to match the important characteristics of the observed data. Given that some of the latest hydrologic models simulate several of the watershed output fluxes (e.g. water, energy, chemical constituents, etc.), there is a need for effective and efficient multi-objective calibration procedures capable of exploiting all of the useful information about the physical system contained in the measurement data time series. The MOCOM-UA algorithm, an effective and efficient methodology for solving the multiple-objective global optimization problem, is presented in this paper. The method is an extension of the successful SCE-UA single-objective global optimization algorithm. The features and capabilities of MOCOM-UA are illustrated by means of a simple hydrologic model calibration study.

Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks

Abstract A system for Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN) is under development at The University of Arizona. The current core of this system is an adaptive Artificial Neural Network (ANN) model that estimates rainfall rates using infrared satellite imagery and ground-surface information. The model was initially calibrated over the Japanese Islands using remotely sensed infrared data collected by the Geostationary Meteorological Satellite (GMS) and ground-based data collected by the Automated Meteorological Data Acquisition System (AMeDAS). The model was then validated for both the Japanese Islands (using GMS and AMeDAS data) and the Florida peninsula (using GOES-8 and NEXRAD data). An adaptive procedure is used to recursively update the network parameters when ground-based data are available. This feature dramatically improves the estimation performance in response to the diverse precipitation characteristics of different geographical regio...

Toward improved calibration of hydrologic models: Combining the strengths of manual and automatic methods

Automatic methods for model calibration seek to take advantage of the speed and power of digital computers, while being objective and relatively easy to implement. However, they do not provide parameter estimates and hydrograph simulations that are considered acceptable by the hydrologists responsible for operational forecasting and have therefore not entered into widespread use. In contrast, the manual approach which has been developed and refined over the years to result in excellent model calibrations is complicated and highly labor-intensive, and the expertise acquired by one individual with a specific model is not easily transferred to another person (or model). In this paper, we propose a hybrid approach that combines the strengths of each. A multicriteria formulation is used to “model” the evaluation techniques and strategies used in manual calibration, and the resulting optimization problem is solved by means of a computerized algorithm. The new approach provides a stronger test of model performance than methods that use a single overall statistic to aggregate model errors over a large range of hydrologie behaviors. The power of the new approach is illustrated by means of a case study using the Sacramento Soil Moisture Accounting model.

Automatic calibration of conceptual rainfall-runoff models: sensitivity to calibration data

Abstract The identification of hydrologic models requires that appropriate data be selected for model calibration. In the research presented here, the shuffled complex evolution (SCE-UA) global optimization method was used to calibrate the NWSRFS-SMA conceptual rainfall-runoff flood forecasting model of the US National Weather Service, using a 40-year record of historical data. Based on 344 calibration runs using different lengths of data from different sections of the historical record, we conclude that approximately 8 years of data are required to obtain calibrations that are relatively insensitive to the period selected. Further, the reduction in parameter uncertainty is maximal when the wettest data periods on record are used. A residual analysis is used to compare the performance of the daily root mean square (DRMS) and heteroscedastic maximum likelihood error (HMLE) objective functions. The results suggest that the factor currently limiting model performance is the unavailability of strategies that explicitly account for model error during calibration.

A decade of Predictions in Ungauged Basins (PUB)—a review

Abstract The Prediction in Ungauged Basins (PUB) initiative of the International Association of Hydrological Sciences (IAHS), launched in 2003 and concluded by the PUB Symposium 2012 held in Delft (23–25 October 2012), set out to shift the scientific culture of hydrology towards improved scientific understanding of hydrological processes, as well as associated uncertainties and the development of models with increasing realism and predictive power. This paper reviews the work that has been done under the six science themes of the PUB Decade and outlines the challenges ahead for the hydrological sciences community. Editor D. Koutsoyiannis Citation Hrachowitz, M., Savenije, H.H.G., Blöschl, G., McDonnell, J.J., Sivapalan, M., Pomeroy, J.W., Arheimer, B., Blume, T., Clark, M.P., Ehret, U., Fenicia, F., Freer, J.E., Gelfan, A., Gupta, H.V., Hughes, D.A., Hut, R.W., Montanari, A., Pande, S., Tetzlaff, D., Troch, P.A., Uhlenbrook, S., Wagener, T., Winsemius, H.C., Woods, R.A., Zehe, E., and Cudennec, C., 2013. A decade of Predictions in Ungauged Basins (PUB)—a review. Hydrological Sciences Journal, 58 (6), 1198–1255.

Bayesian recursive parameter estimation for hydrologic models

The uncertainty in a given hydrologic prediction is the compound effect of the parameter, data, and structural uncertainties associated with the underlying model. In general, therefore, the confidence in a hydrologic prediction can be improved by reducing the uncertainty associated with the parameter estimates. However, the classical approach to doing this via model calibration typically requires that considerable amounts of data be collected and assimilated before the model can be used. This limitation becomes immediately apparent when hydrologic predictions must be generated for a previously ungauged watershed that has only recently been instrumented. This paper presents the framework for a Bayesian recursive estimation approach to hydrologic prediction that can be used for simultaneous parameter estimation and prediction in an operational setting. The prediction is described in terms of the probabilities associated with different output values. The uncertainty associated with the parameter estimates is updated (reduced) recursively, resulting in smaller prediction uncertainties as measurement data are successively assimilated. The effectiveness and efficiency of the method are illustrated in the context of two models: a simple unit hydrograph model and the more complex Sacramento soil moisture accounting model, using data from the Leaf River basin in Mississippi.

Integration of soil moisture remote sensing and hydrologic modeling using data assimilation

The feasibility of synthesizing distributed fields of soil moisture by the novel application of four-dimensional data assimilation (4DDA) applied in a hydrological model is explored. Six 160-km2 push broom microwave radiometer (PBMR) images gathered over the Walnut Gulch experimental watershed in southeast Arizona were assimilated into the Topmodel-based Land-Atmosphere Transfer Scheme (TOPLATS) using several alternative assimilation procedures. Modification of traditional assimilation methods was required to use these high-density PBMR observations. The images were found to contain horizontal correlations that imply length scales of several tens of kilometers, thus allowing information to be advected beyond the area of the image. Information on surface soil moisture also was assimilated into the subsurface using knowledge of the surface- subsurface correlation. Newtonian nudging assimilation procedures are preferable to other techniques because they nearly preserve the observed patterns within the sampled region but also yield plausible patterns in unmeasured regions and allow information to be advected in time.