Gabriele Freni

Comparison of different uncertainty techniques in urban stormwater quantity and quality modelling

Urban drainage models are important tools used by both practitioners and scientists in the field of stormwater management. These models are often conceptual and usually require calibration using local datasets. The quantification of the uncertainty associated with the models is a must, although it is rarely practiced. The International Working Group on Data and Models, which works under the IWA/IAHR Joint Committee on Urban Drainage, has been working on the development of a framework for defining and assessing uncertainties in the field of urban drainage modelling. A part of that work is the assessment and comparison of different techniques generally used in the uncertainty assessment of the parameters of water models. This paper compares a number of these techniques: the Generalized Likelihood Uncertainty Estimation (GLUE), the Shuffled Complex Evolution Metropolis algorithm (SCEM-UA), an approach based on a multi-objective auto-calibration (a multialgorithm, genetically adaptive multi-objective method, AMALGAM) and a Bayesian approach based on a simplified Markov Chain Monte Carlo method (implemented in the software MICA). To allow a meaningful comparison among the different uncertainty techniques, common criteria have been set for the likelihood formulation, defining the number of simulations, and the measure of uncertainty bounds. Moreover, all the uncertainty techniques were implemented for the same case study, in which the same stormwater quantity and quality model was used alongside the same dataset. The comparison results for a well-posed rainfall/runoff model showed that the four methods provide similar probability distributions of model parameters, and model prediction intervals. For ill-posed water quality model the differences between the results were much wider; and the paper provides the specific advantages and disadvantages of each method. In relation to computational efficiency (i.e. number of iterations required to generate the probability distribution of parameters), it was found that SCEM-UA and AMALGAM produce results quicker than GLUE in terms of required number of simulations. However, GLUE requires the lowest modelling skills and is easy to implement. All non-Bayesian methods have problems with the way they accept behavioural parameter sets, e.g. GLUE, SCEM-UA and AMALGAM have subjective acceptance thresholds, while MICA has usually problem with its hypothesis on normality of residuals. It is concluded that modellers should select the method which is most suitable for the system they are modelling (e.g. complexity of the models structure including the number of parameters), their skill/knowledge level, the available information, and the purpose of their study.

Uncertainty in urban stormwater quality modelling: The effect of acceptability threshold in the GLUE methodology

Uncertainty analysis in integrated urban drainage modelling is of growing importance in the field of water quality. However, only few studies deal with uncertainty quantification in urban drainage modelling; furthermore, the few existing studies mainly focus on quantitative sewer flow modelling rather than uncertainty in water quality aspects. In this context, the generalised likelihood uncertainty estimation (GLUE) methodology was applied for the evaluation of the uncertainty of an integrated urban drainage model and some of its subjective hypotheses have been explored. More specifically, the influence of the subjective choice of the acceptability threshold has been detected in order to gain insights regarding its effect on the model results. The model has been applied to the Savena case study (Bologna, Italy) where water quality and quantity data were available. The model results show a strong influence of the acceptability threshold selection and confirm the importance of modellers experience in the application of GLUE uncertainty analysis.

Uncertainty in urban flood damage assessment due to urban drainage modelling and depth-damage curve estimation.

Due to the increased occurrence of flooding events in urban areas, many procedures for flood damage quantification have been defined in recent decades. The lack of large databases in most cases is overcome by combining the output of urban drainage models and damage curves linking flooding to expected damage. The application of advanced hydraulic models as diagnostic, design and decision-making support tools has become a standard practice in hydraulic research and application. Flooding damage functions are usually evaluated by a priori estimation of potential damage (based on the value of exposed goods) or by interpolating real damage data (recorded during historical flooding events). Hydraulic models have undergone continuous advancements, pushed forward by increasing computer capacity. The details of the flooding propagation process on the surface and the details of the interconnections between underground and surface drainage systems have been studied extensively in recent years, resulting in progressively more reliable models. The same level of was advancement has not been reached with regard to damage curves, for which improvements are highly connected to data availability; this remains the main bottleneck in the expected flooding damage estimation. Such functions are usually affected by significant uncertainty intrinsically related to the collected data and to the simplified structure of the adopted functional relationships. The present paper aimed to evaluate this uncertainty by comparing the intrinsic uncertainty connected to the construction of the damage-depth function to the hydraulic model uncertainty. In this way, the paper sought to evaluate the role of hydraulic model detail level in the wider context of flood damage estimation. This paper demonstrated that the use of detailed hydraulic models might not be justified because of the higher computational cost and the significant uncertainty in damage estimation curves. This uncertainty occurs mainly because a large part of the total uncertainty is dependent on depth-damage curves. Improving the estimation of these curves may provide better results in term of uncertainty reduction than the adoption of detailed hydraulic models.

Evaluation of the apparent losses caused by water meter under-registration in intermittent water supply.

Apparent losses are usually caused by water theft, billing errors, or revenue meter under-registration. While the first two causes are directly related to water utility management and may be reduced by improving company procedures, water meter inaccuracies are considered to be the most significant and hardest to quantify. Water meter errors are amplified in networks subjected to water scarcity, where users adopt private storage tanks to cope with the intermittent water supply. The aim of this paper is to analyse the role of two variables influencing the apparent losses: water meter age and the private storage tank effect on meter performance. The study was carried out in Palermo (Italy). The impact of water meter ageing was evaluated in laboratory by testing 180 revenue meters, ranging from 0 to 45 years in age. The effects of the private water tanks were determined via field monitoring of real users and a mathematical model. This study demonstrates that the impact on apparent losses from the meter starting flow rapidly increases with meter age. Private water tanks, usually fed by a float valve, overstate meter under-registration, producing additional apparent losses between 15% and 40% for the users analysed in this study.

Identifiability analysis for receiving water body quality modelling

In urban drainage, new computational possibilities have supported the development of new integrated approaches aimed at joint water quantity and quality analysis of the whole urban drainage system. Although the benefit of an integrated approach has been widely demonstrated, to date, several aspects prevent its applicability such as scarce availability of field data if compared with model complexity. These aspects sometimes prevent the correct estimation of parameters thus leading to large uncertainty in modelling response. This is a typical parameter identifiability problem that is discussed in the present paper evaluating the effect of identifiability procedures in increasing operator confidence in modelling results. The methodology presented has been applied to a home-made integrated urban drainage model that has been calibrated/validated considering field data collected in the Savena experimental catchment (Bologna, Italy). The results demonstrate the effectiveness of the identifiability analysis in obtaining a tool for urban integrated modelling applications and field data gathering campaigns.

A model of the filling process of an intermittent distribution network

In many countries, private tanks are acquired by users to reduce their vulnerability to intermittent supply. The presence of these local reservoirs modifies the user demand pattern and usually increases user water demand at the beginning of the service period depending on the tank filling process. This practice is thus responsible for the inequality that occurs among users: those located in advantaged positions of the network are able to obtain water resources soon after the service period begins, while disadvantaged users have to wait much longer, after the network is full. This dynamic process requires the development of ad hoc models in order to obtain reliable results. This paper discusses a numerical model used for evaluating this complex process as well as the application of model to an Italian case study. The model agreed with calibration data and provided interesting insights into the network filling process.

Assessment of the integrated urban water quality model complexity through identifiability analysis

Urban sources of water pollution have often been cited as the primary cause of poor water quality in receiving water bodies (RWB), and recently many studies have been conducted to investigate both continuous sources, such as wastewater-treatment plant (WWTP) effluents, and intermittent sources, such as combined sewer overflows (CSOs). An urban drainage system must be considered jointly, i.e., by means of an integrated approach. However, although the benefits of an integrated approach have been widely demonstrated, several aspects have prevented its wide application, such as the scarcity of field data for not only the input and output variables but also parameters that govern intermediate stages of the system, which are useful for robust calibration. These factors, along with the high complexity level of the currently adopted approaches, introduce uncertainties in the modelling process that are not always identifiable. In this study, the identifiability analysis was applied to a complex integrated catchment: the Nocella basin (Italy). This system is characterised by two main urban areas served by two WWTPs and has a small river as the RWB. The system was simulated by employing an integrated model developed in previous studies. The main goal of the study was to assess the right number of parameters that can be estimated on the basis of data-source availability. A preliminary sensitivity analysis was undertaken to reduce the model parameters to the most sensitive ones. Subsequently, the identifiability analysis was carried out by progressively considering new data sources and assessing the added value provided by each of them. In the process, several identifiability methods were compared and some new techniques were proposed for reducing subjectivity of the analysis. The study showed the potential of the identifiability analysis for selecting the most relevant parameters in the model, thus allowing for model simplification, and in assessing the impact of data sources for model reliability, thus guiding the analyst in the design of future monitoring campaigns. Further, the analysis showed some critical points in integrated urban drainage modelling, such as the interaction between water quality processes on the catchment and in the sewer, that can prevent the identifiability of some of the related parameters.

Assessment of data availability influence on integrated urban drainage modelling uncertainty

In urban water quality management, several models are connected and integrated for analysing the fate of pollutants from the sources in the urban catchment to the final recipient; classical problems connected with the selection and calibration of parameters are amplified by the complexity of the modelling approach increasing their uncertainty. The present paper aims at studying the influence of reductions in available data on the modelling response uncertainty with respect to the different integrated modelling outputs (both considering quantity and quality variables). At this scope, a parsimonious integrated home-made model has been used allowing for analysing the combinative effect of data availability regarding the different parts of the integrated urban drainage system; the uncertainty analysis approach has been applied to an experimental catchment in Bologna (Italy). The number of available data points has been fictitiously reduced obtaining data sets ranging between 25% and 100% of the actually measured data. For each of the data sets, uncertainty has been evaluated and its propagation from the upstream sub-model to the downstream ones has been assessed. The present study demonstrates that model calibration and modelling efficiency assessment may induce the operator to be excessively confident in the model results when available data are scarce. Quite the opposite is indeed true, that limited data availability increases modelling uncertainty. A conclusion of this article is that uncertainty analysis should always be conducted in order to effectively evaluate model reliability.

Uncertainty in urban stormwater quality modelling: The influence of likelihood measure formulation in the GLUE methodology

In the last years, the attention on integrated analysis of sewer networks, wastewater treatment plants and receiving waters has been growing. However, the common lack of data in the urban water-quality field and the incomplete knowledge regarding the interpretation of the main phenomena taking part in integrated urban water systems draw attention to the necessity of evaluating the reliability of model results. Uncertainty analysis can provide useful hints and information regarding the best model approach to be used by assessing its degrees of significance and reliability. Few studies deal with uncertainty assessment in the integrated urban-drainage field. In order to fill this gap, there has been a general trend towards transferring the knowledge and the methodologies from other fields. In this respect, the Generalised Likelihood Uncertainty Evaluation (GLUE) methodology, which is widely applied in the field of hydrology, can be a possible candidate for providing a solution to the above problem. However, the methodology relies on several user-defined hypotheses in the selection of a specific formulation of the likelihood measure. This paper presents a survey aimed at evaluating the influence of the likelihood measure formulation in the assessment of uncertainty in integrated urban-drainage modelling. To accomplish this objective, a home-made integrated urban-drainage model was applied to the Savena case study (Bologna, IT). In particular, the integrated urban-drainage model uncertainty was evaluated employing different likelihood measures. The results demonstrate that the subjective selection of the likelihood measure greatly affects the GLUE uncertainty analysis.

Performance of membrane bioreactor (MBR) systems for the treatment of shipboard slops: Assessment of hydrocarbon biodegradation and biomass activity under salinity variation.

In order to prevent hydrocarbon discharge at sea from ships, the International Maritime Organization (IMO) enacted the MARPOL 73/78 convention in which any oil and oil residue discharged in wastewater streams must contain less than 5 ppm hydrocarbons. Effective treatment of this petroleum-contaminated water is essential prior to its release into the environment, in order to prevent pollution problem for marine ecosystems as well as for human health. Therefore, two bench scale membrane bioreactors (MBRs) were investigated for hydrocarbon biodegradation. The two plants were initially fed with synthetic wastewater characterised by an increasing salinity, in order to enhance biomass acclimation to salinity. Subsequently, they were fed with a mixture of synthetic wastewater and real shipboard slops (with an increasing slops percentage up to 50% by volume). The results indicated a satisfactory biomass acclimation level in both plants with regards to salinity, providing significant removal efficiencies. The real slops exerted an inhibitory effect on the biomass, partially due to hydrocarbons as well as to other concomitant influences from other compounds contained in the real slops difficult to evaluate a priori. Nevertheless, a slight adaptation of the biomass to the new conditions was observed, with increasing removal efficiencies, despite the significant slops percentage.