Jeffrey M. Keisler

Multi-criteria decision analysis in environmental sciences: Ten years of applications and trends

Decision-making in environmental projects requires consideration of trade-offs between socio-political, environmental, and economic impacts and is often complicated by various stakeholder views. Multi-criteria decision analysis (MCDA) emerged as a formal methodology to face available technical information and stakeholder values to support decisions in many fields and can be especially valuable in environmental decision making. This study reviews environmental applications of MCDA. Over 300 papers published between 2000 and 2009 reporting MCDA applications in the environmental field were identified through a series of queries in the Web of Science database. The papers were classified by their environmental application area, decision or intervention type. In addition, the papers were also classified by the MCDA methods used in the analysis (analytic hierarchy process, multi-attribute utility theory, and outranking). The results suggest that there is a significant growth in environmental applications of MCDA over the last decade across all environmental application areas. Multiple MCDA tools have been successfully used for environmental applications. Even though the use of the specific methods and tools varies in different application areas and geographic regions, our review of a few papers where several methods were used in parallel with the same problem indicates that recommended course of action does not vary significantly with the method applied.

A decision-directed approach for prioritizing research into the impact of nanomaterials on the environment and human health

The emergence of nanotechnology has coincided with an increased recognition of the need for new approaches to understand and manage the impact of emerging technologies on the environment and human health. Important elements in these new approaches include life-cycle thinking, public participation and adaptive management of the risks associated with emerging technologies and new materials. However, there is a clear need to develop a framework for linking research on the risks associated with nanotechnology to the decision-making needs of manufacturers, regulators, consumers and other stakeholder groups. Given the very high uncertainties associated with nanomaterials and their impact on the environment and human health, research resources should be directed towards creating the knowledge that is most meaningful to these groups. Here, we present a model (based on multi-criteria decision analysis and a value of information approach) for prioritizing research strategies in a way that is responsive to the recommendations of recent reports on the management of the risk and impact of nanomaterials on the environment and human health.

Advanced solar R&D: Combining economic analysis with expert elicitations to inform climate policy

The relationship between R&D investments and technical change is inherently uncertain. In this paper we combine economics and decision analysis to incorporate the uncertainty of technical change into climate change policy analysis. We present the results of an expert elicitation on the prospects for technical change in advanced solar photovoltaics. We then use the results of the expert elicitations as inputs to the MiniCAM integrated assessment model, to derive probabilistic information about the impacts of R&D investments on the costs of emissions abatement.

Integration of Decision Analysis and Scenario Planning for Coastal Engineering and Climate Change

This paper develops a methodology for eliciting shifts in preference across future scenarios in the performance assessment of infrastructure policies and investments. The methodology quantifies the robustness of alternative portfolios across a variety of scenarios and identifies the scenarios that greatly affect the assessments. An innovation of the methodology is to elicit, for each scenario, only a few relative increases or decreases in importance of selected terms of the value function, which is more efficient than a full elicitation of the value function for each scenario. The identification of critical scenarios via our methodology can be used to focus resource-intensive and potentially costly modeling activities. The methodology integrates preference orders, centroid weights, and the Borda method. In a demonstration, the methodology assesses the relative sea level and other climate-change scenarios that could affect the performance of coastal protections.

Operational resilience: concepts, design and analysis

Building resilience into today’s complex infrastructures is critical to the daily functioning of society and its ability to withstand and recover from natural disasters, epidemics, and cyber-threats. This study proposes quantitative measures that capture and implement the definition of engineering resilience advanced by the National Academy of Sciences. The approach is applicable across physical, information, and social domains. It evaluates the critical functionality, defined as a performance function of time set by the stakeholders. Critical functionality is a source of valuable information, such as the integrated system resilience over a time interval, and its robustness. The paper demonstrates the formulation on two classes of models: 1) multi-level directed acyclic graphs, and 2) interdependent coupled networks. For both models synthetic case studies are used to explore trends. For the first class, the approach is also applied to the Linux operating system. Results indicate that desired resilience and robustness levels are achievable by trading off different design parameters, such as redundancy, node recovery time, and backup supply available. The nonlinear relationship between network parameters and resilience levels confirms the utility of the proposed approach, which is of benefit to analysts and designers of complex systems and networks.

Value of Information in Portfolio Decision Analysis

It can be time consuming to use decision analysis to allocate resources over a portfolio of projects. It may be possible to attain most of the value added by decision analysis in significantly less time. This paper defines and compares different analytic strategies in terms of the resulting value added for a range of simulated portfolios. A portfolio consists of a set of candidate projects or investments of uncertain value. The value of each project may be estimated with or without the additional information provided by decision-analytic methods. Projects are then completely prioritized and funded in order of the ratio of their expected net present value to their cost, or partially prioritized and funded whenever this ratio exceeds a predefined threshold level. The portfolio funded under the various analytic strategies is compared against a strawman alternative of random funding decisions. The value added through disciplined prioritization often exceeds the additional value added through the more costly step of developing refined estimates of project values. Intermediate approaches, including threshold approaches and the application of triage rules to determine which projects to analyze, are found to be useful but not robust.

Climate change scenarios: risk and impact analysis for Alaska coastal infrastructure

Climate change has the potential to impose severe stress on coastal environments. Alaskan coastlines are especially vulnerable to erosion and other changes that have led to significant damage and threats to infrastructure, human health and safety, and economic prosperity. This paper describes an integration of scenario analysis with multi-criteria decision analysis to prioritise the vulnerability of communities for the development of infrastructure protection and other actions. The approach allows stakeholders to account for uncertainty in the prioritisation and also includes value judgements of the multiple relevant stakeholders. We present a case study that evaluates several climate change scenarios and formulates metrics for finding scenarios that most impact priorities. Scenarios including sea-level rise, increased frequency of forest fires, permafrost melting, and others are used. We find the increased frequency of forest fires to be the most upsetting scenario along with four communities that are identified as highly vulnerable and not sensitive to the scenarios.

An Invitation to Portfolio Decision Analysis

Portfolio Decision Analysis (PDA) – the application of decision analysis to the problem of selecting a subset or portfolio from a large set of alternatives – accounts for a significant share, perhaps the greater part, of decision analysis consulting. PDA has a sound theoretical and methodological basis, and its ability to contribute to better resource allocation decisions has been demonstrated in numerous applications. This book pulls together some of the rich and diverse efforts as a starting point for treating PDA as a promising and distinct area of study and application. In this introductory chapter, we first describe what we mean by PDA. We then sketch the historical development of some key ideas, outline the contributions contained in the chapters and, finally, offer personal perspectives on future work in this sub-field of decision analysis that merits growing attention.

From "Weight of Evidence" to Quantitative Data Integration using Multicriteria Decision Analysis and Bayesian Methods

Summary “Weighing” available evidence in the process of decision-making is unavoidable, yet it is one step that routinely raises suspicions: what evidence should be used, how much does it weigh, and whose thumb may be tipping the scales? This commentary aims to evaluate the current state and future roles of various types of evidence for hazard assessment as it applies to environmental health. In its recent evaluation of the US Environmental Protection Agency’s Integrated Risk Information System assessment process, the National Research Council committee singled out the term “weight of evidence” (WoE) for critique, deeming the process too vague and detractive to the practice of evaluating human health risks of chemicals. Moving the methodology away from qualitative, vague and controversial methods towards generalizable, quantitative and transparent methods for appropriately managing diverse lines of evidence is paramount for both regulatory and public acceptance of the hazard assessments. The choice of terminology notwithstanding, a number of recent Bayesian WoE-based methods, the emergence of multi criteria decision analysis for WoE applications, as well as the general principles behind the foundational concepts of WoE, show promise in how to move forward and regain trust in the data integration step of the assessments. We offer our thoughts on the current state of WoE as a whole and while we acknowledge that many WoE applications have been largely qualitative and subjective in nature, we see this as an opportunity to turn WoE towards a quantitative direction that includes Bayesian and multi criteria decision analysis.

Enhanced Adaptive Management: Integrating Decision Analysis, Scenario Analysis and Environmental Modeling for the Everglades

We propose to enhance existing adaptive management efforts with a decision-analytical approach that can guide the initial selection of robust restoration alternative plans and inform the need to adjust these alternatives in the course of action based on continuously acquired monitoring information and changing stakeholder values. We demonstrate an application of enhanced adaptive management for a wetland restoration case study inspired by the Florida Everglades restoration effort. We find that alternatives designed to reconstruct the pre-drainage flow may have a positive ecological impact, but may also have high operational costs and only marginally contribute to meeting other objectives such as reduction of flooding. Enhanced adaptive management allows managers to guide investment in ecosystem modeling and monitoring efforts through scenario and value of information analyses to support optimal restoration strategies in the face of uncertain and changing information.