Anne Knol

Expert elicitation on ultrafine particles: likelihood of health effects and causal pathways

BackgroundExposure to fine ambient particulate matter (PM) has consistently been associated with increased morbidity and mortality. The relationship between exposure to ultrafine particles (UFP) and health effects is less firmly established. If UFP cause health effects independently from coarser fractions, this could affect health impact assessment of air pollution, which would possibly lead to alternative policy options to be considered to reduce the disease burden of PM. Therefore, we organized an expert elicitation workshop to assess the evidence for a causal relationship between exposure to UFP and health endpoints.MethodsAn expert elicitation on the health effects of ambient ultrafine particle exposure was carried out, focusing on: 1) the likelihood of causal relationships with key health endpoints, and 2) the likelihood of potential causal pathways for cardiac events. Based on a systematic peer-nomination procedure, fourteen European experts (epidemiologists, toxicologists and clinicians) were selected, of whom twelve attended. They were provided with a briefing book containing key literature. After a group discussion, individual expert judgments in the form of ratings of the likelihood of causal relationships and pathways were obtained using a confidence scheme adapted from the one used by the Intergovernmental Panel on Climate Change.ResultsThe likelihood of an independent causal relationship between increased short-term UFP exposure and increased all-cause mortality, hospital admissions for cardiovascular and respiratory diseases, aggravation of asthma symptoms and lung function decrements was rated medium to high by most experts. The likelihood for long-term UFP exposure to be causally related to all cause mortality, cardiovascular and respiratory morbidity and lung cancer was rated slightly lower, mostly medium. The experts rated the likelihood of each of the six identified possible causal pathways separately. Out of these six, the highest likelihood was rated for the pathway involving respiratory inflammation and subsequent thrombotic effects.ConclusionThe overall medium to high likelihood rating of causality of health effects of UFP exposure and the high likelihood rating of at least one of the proposed causal mechanisms explaining associations between UFP and cardiac events, stresses the importance of considering UFP in future health impact assessments of (transport-related) air pollution, and the need for further research on UFP exposure and health effects.

The use of expert elicitation in environmental health impact assessment: a seven step procedure

BackgroundEnvironmental health impact assessments often have to deal with substantial uncertainties. Typically, the knowledge-base is limited with incomplete, or inconsistent evidence and missing or ambiguous data. Consulting experts can help to identify and address uncertainties.MethodsFormal expert elicitation is a structured approach to systematically consult experts on uncertain issues. It is most often used to quantify ranges for poorly known parameters, but may also be useful to further develop qualitative issues such as definitions, assumptions or conceptual (causal) models. A thorough preparation and systematic design and execution of an expert elicitation process may increase the validity of its outcomes and transparency and trustworthiness of its conclusions. Various expert elicitation protocols and methods exist. However, these are often not universally applicable, and need customization to suite the needs of a specific study. In this paper, we set out to develop a widely applicable method for the use of expert elicitation in environmental health impact assessment.ResultsWe present a practical yet flexible seven step procedure towards organising expert elicitation in the context of environmental health impact assessment, based on existing protocols. We describe how customization for specific applications is always necessary. In particular, three issues affect the choice of methods for a particular application: the types of uncertainties considered, the intended use of the elicited information, and the available resources. We outline how these three considerations guide choices regarding the design and execution of expert elicitation. We present signposts to sources where the issues are discussed in more depth to give the newcomer the insights needed to make the protocol work. The seven step procedure is illustrated using examples from earlier published elicitations in the field of environmental health research.ConclusionsWe conclude that, despite some known criticism on its validity, formal expert elicitation can support environmental health research in various ways. Its main purpose is to provide a temporary summary of the limited available knowledge, which can serve as a provisional basis for policy until further research has been carried out.

Concentration Response Functions for Ultrafine Particles and All-Cause Mortality and Hospital Admissions: Results of a European Expert Panel Elicitation

Toxicological studies have provided evidence of the toxicity of ultrafine particles (UFP), but epidemiological evidence for health effects of ultrafines is limited. No quantitative summary currently exists of concentration-response functions for ultrafine particles that can be used in health impact assessment. The goal was to specify concentration-response functions for ultrafine particles in urban air including their uncertainty through an expert panel elicitation. Eleven European experts from the disciplines of epidemiology, toxicology, and clinical medicine selected using a systematic peer-nomination procedure participated. Using individual ratings supplemented with group discussion, probability distributions of effect estimates were obtained for all-cause mortality and cardiovascular and respiratory hospital admissions. Experts judged the small database of epidemiological studies supplemented with experimental studies sufficient to quantify effects of UFP on all-cause mortality and to a lesser extent hospital admissions. Substantial differences in the estimated UFP health effect and its uncertainty were found between experts. The lack of studies on long-term exposure to UFP was rated as the most important source of uncertainty. Effects on hospital admissions were considered more uncertain. This expert elicitation provides the first quantitative evaluation of estimates of concentration response functions between urban air ultrafine particles and all-cause mortality and hospital admissions.

Dealing with uncertainties in environmental burden of disease assessment.

Disability Adjusted Life Years (DALYs) combine the number of people affected by disease or mortality in a population and the duration and severity of their condition into one number. The environmental burden of disease is the number of DALYs that can be attributed to environmental factors. Environmental burden of disease estimates enable policy makers to evaluate, compare and prioritize dissimilar environmental health problems or interventions. These estimates often have various uncertainties and assumptions which are not always made explicit. Besides statistical uncertainty in input data and parameters – which is commonly addressed – a variety of other types of uncertainties may substantially influence the results of the assessment. We have reviewed how different types of uncertainties affect environmental burden of disease assessments, and we give suggestions as to how researchers could address these uncertainties. We propose the use of an uncertainty typology to identify and characterize uncertainties. Finally, we argue that uncertainties need to be identified, assessed, reported and interpreted in order for assessment results to adequately support decision making.

Assessment of complex environmental health problems: Framing the structures and structuring the frameworks

Many environmental risks are multi-faceted and their health consequences can be far-ranging in both time and space. It can be a challenging task to develop informed policies for such risks. Integrated environmental health impact assessment aims to support policy by assessing environmental health effects in ways that take into account the complexities and uncertainties involved. For such assessment to be successful, a clear and agreed conceptual framework is needed, which defines the issue under consideration and sets out the principles on which the assessment is based. Conceptual frameworks facilitate involvement of stakeholders, support harmonized discussions, help to make assumptions explicit, and provide a framework for data analysis and interpretation. Various conceptual frameworks have been developed for different purposes, but as yet no clear taxonomy exists. We propose a three-level taxonomy of conceptual frameworks for use in environmental health impact assessment. At the first level of the taxonomy, structural frameworks show the wide context of the issues at hand. At the second level, relational frameworks describe how the assessment variables are causally related. At the third level, this causal structure is translated into an operational model, which serves as a basis for analysis. The different types of frameworks are complementary and all play a role in the assessment process. The taxonomy is illustrated using a hypothetical assessment of urban brownfield development for residential uses. We suggest that a better understanding of types of conceptual frameworks and their potential roles in the different phases of assessment will contribute to more informed assessments and policies.

Uncertainty of Population Risk Estimates for Pathogens Based on QMRA or Epidemiology: A Case Study of Campylobacter in the Netherlands

Epidemiology and quantitative microbiological risk assessment are disciplines in which the same public health measures are estimated, but results differ frequently. If large, these differences can confuse public health policymakers. This article aims to identify uncertainty sources that explain apparent differences in estimates for Campylobacter spp. incidence and attribution in the Netherlands, based on four previous studies (two for each discipline). An uncertainty typology was used to identify uncertainty sources and the NUSAP method was applied to characterize the uncertainty and its influence on estimates. Model outcomes were subsequently calculated for alternative scenarios that simulated very different but realistic alternatives in parameter estimates, modeling, data handling, or analysis to obtain impressions of the total uncertainty. For the epidemiological assessment, 32 uncertainty sources were identified and for QMRA 67. Definitions (e.g., of a case) and study boundaries (e.g., of the studied pathogen) were identified as important drivers for the differences between the estimates of the original studies. The range in alternatively calculated estimates usually overlapped between disciplines, showing that proper appreciation of uncertainty can explain apparent differences between the initial estimates from both disciplines. Uncertainty was not estimated in the original QMRA studies and underestimated in the epidemiological studies. We advise to give appropriate attention to uncertainty in QMRA and epidemiological studies, even if only qualitatively, so that scientists and policymakers can interpret reported outcomes more correctly. Ideally, both disciplines are joined by merging their strong respective properties, leading to unified public health measures.

Different Roles and Viewpoints of Scientific Experts in Advising on Environmental Health Risks

Environmental health risks are often complex, largescale, and uncertain. The uncertainties inherent in these problems permit differences among experts in the appraisal of risks. This raises the question of whether different expert roles exist and, if so, how this affects the policy advice that is given. Here, we present a pilot study of the different roles and viewpoints that can be discerned among scientific experts in the Netherlands. Q methodology was used to empirically explore existing theoretical treatises on different expert roles. In total, 26 electromagnetic field (EMF) experts and 21 particulate matter (PM) experts participated. The responses were analyzed separately for EMF and PM respondents using Q factor analysis. In both the EMF and PM domain, three different expert roles were identified. This suggests that particular expert roles depend on the specific environmental health risk. The results indicate that different expert roles exist among scientists who provide policy advice on environmental health risks. This empirical study adds new data and insights to the literature on expert roles. The results of this study are relevant for the selection and composition of expert committees and the interpretation of expert advice.

Different roles of electromagnetic field experts when giving policy advice: an expert consultation

BackgroundThe overall evidence for adverse health effects of electromagnetic fields (EMF) at levels of exposure normally experienced by the public is generally considered weak. However, whether long-term health effects arise remains uncertain and scientific policy advice is therefore given against a background of uncertainty. Several theories exist about different roles that experts may take when they provide advice on complex issues such as EMF. To provide empirical evidence for these theories, we conducted an expert consultation with as main research question: What are the different roles of EMF experts when they provide policy advice?MethodsQ methodology was used to empirically test theoretical notions on the existence and determinants of different expert roles and to analyze which roles actually play out in the domain of EMF. Experts were selected based on a structured nominee process. In total 32 international EMF experts participated. Responses were analyzed using Principal Component Analysis and for the open questions we used Atlas.ti.ResultsFour expert roles were found. Most striking differences between the four roles are whether experts consider current EMF policies adequate or not, whether additional –precautionary– measures are needed, and how experts view their position vis-à-vis policymakers and/or other stakeholders.ConclusionThis empirical study provides support for the so far mainly theoretical debate about the existence of different roles of experts when they give policy advice. The experts’ assessment of the degree of uncertainty of the issue turned out to be highly associated with their role. We argue that part of the controversy that exists in the debate regarding scientific policy advice on EMF is about different values and roles.

Can a pre-assessment help us to properly manage controversial risks of chemicals? A discussion on potential improvement of the REACH restriction process

The REACH regulation has been adopted to regulate the safe use of chemicals in Europe. One of the instruments of this regulation is the restriction of chemicals that cause unacceptable risks. A Member State can prepare a dossier to propose the restriction of the placing on the market or use of a substance. Up to now, seven restriction proposals have been evaluated, based primarily on the best scientific information available (predominantly on the Risk Assessment, RA). Experience with one of these dossiers, on phthalates, has learned that dossiers that are very uncertain, contested or ambiguous would, in addition to the RA, benefit from a Socio-Economic Analysis (SEA). This may avoid prolonged concern and societal debate among European citizens and scientists and prevents improper or incomplete informed decision-making. For ambiguous risks like phthalates, the use of a more extensive SEA in addition to the RA might help to weigh all relevant aspects in the subsequent decision-making. The use of (extensive) SEA does not seem necessary for all types of risks. Therefore, we argue that the REACH restriction process would benefit from a pre-assessment in which the type of risk to be managed is characterized. The subsequent evaluation process can then be designed according to the type of risk at hand.

Environmental Burden of Disease in European Countries—The EBoDE Project

The experts participating in the Environmental Burden of Disease – European countries project agreed on the specific tasks and timetable. The steering group and specific task groups were established. The first project results should be ready for presentation at the Fifth Ministerial Conference on Environment and Health in March 2010 in Parma, Italy. Address requests about publications of the WHO Regional Office for Europe to: Publications WHO Regional Office for Europe Scherfigsvej 8 DK-2100 Copenhagen Ø, Denmark Alternatively, complete an online request form for documentation, health information, or for permission to quote or translate, on the Regional Office web site (http://www.euro.who.int/pubrequest).