Elena Savoia

Assessing the construct validity of the Italian version of the EQ-5D: preliminary results from a cross-sectional study in North Italy

BackgroundInformation on health related quality of life (HR-QOL) can be integrated with other classical health status indicators and be used to assist policy makers in resource allocation decisions. For this reason instruments such as the SF-12 and EQ-5D have been widely proposed as assessment tools to monitor changes in HR-QOL in general populations and very recently in general practice settings as wellAimThe primary goal of our study was to assess the construct validity of the Italian version of the EQ-5D in a general population of North Italy using socio-demographic factors and diagnostic sub-groups. Our secondary goal was to assess the concurrent validity of the EQ-5D and SF-12.MethodsThe SF-12, the EQ-5D plus an additional questionnaire on socio-demographic characteristics, clinical conditions and symptoms were completed by 1,622 adults, randomly selected from the Registry of the Health Authorities of the city of Bologna, Italy. The primary care physician of each subject was contacted to report on the subjects health status.ResultsOur findings indicate that the Italian version of the EQ-5D is well accepted by the general population (91% response rate), has good reliability (Cronbachs alpha 0.73), and shows evidence of construct validity.ConclusionOur data provide a basis for further research to be conducted to assess the validity of the EQ-5D in Italy. In particular future studies should focus on assessing its ability to detect a clinically important change in health related quality of life over time (responsiveness).

Use of After Action Reports (AARs) to Promote Organizational and Systems Learning in Emergency Preparedness

Many public health and healthcare organizations use formal knowledge management practices to identify and disseminate the experiences gained over time. The “lessons-learned” approach is one such example of knowledge management practice applied to the wider concept of organizational learning. In the field of emergency preparedness, the lessons-learned approach stands on the assumption that learning from experience improves practice and minimizes avoidable deaths and negative economic and social consequences of disasters. In this project, we performed a structured review of AARs to analyze how lessons learned from the response to real-incidents may be used to maximize knowledge management and quality improvement practices such as the design of public health emergency preparedness (PHEP) exercises. We chose as a source of data the “Lessons Learned Information Sharing (LLIS.gov)” system, a joined program of the U.S. Department of Homeland Security DHS and FEMA that serves as the national, online repository of lessons learned, best practices, and innovative ideas. We identified recurring challenges reported by various states and local public health agencies in the response to different types of incidents. We also strived to identify the limitations of systematic learning that can be achieved due to existing weaknesses in the way AARs are developed.

Assessing Public Health Capabilities During Emergency Preparedness Tabletop Exercises: Reliability and Validity of a Measurement Tool

Objectives. Improving the ability of local public health agencies to respond to large-scale emergencies is an ongoing challenge. Tabletop exercises can provide an opportunity for individuals and groups to practice coordination of emergency response and evaluate performance. The purpose of this study was to develop a valid and reliable self-assessment performance measurement tool for tabletop exercise participants. Methods. The study population comprised 179 public officials who attended three tabletop exercises in Massachusetts and Maine between September 2005 and November 2006. A 42-item questionnaire was developed to assess five public health functional capabilities: (1) leadership and management, (2) mass casualty care, (3) communication, (4) disease control and prevention, and (5) surveillance and epidemiology. Analyses were undertaken to examine internal consistency, associations among scales, the empirical structure of the items, and inter-rater agreement. Results. Thirty-seven questions were retained in the final questionnaire and grouped according to the original five domains. Alpha coefficients were 0.81 or higher for all scales. The five-factor solution from the principal components analysis accounted for 60% of the total variance, and the factor structure was consistent with the five domains of the original conceptual model. Inter-rater agreement ranged from good to excellent. Conclusions. The resulting 37-item performance measurement tool was found to reliably measure public health functional capabilities in a tabletop exercise setting, with preliminary evidence of a factor structure consistent with the original conceptualization and of criterion-related validity.

EMERGENCY PREPAREDNESS FOR VULNERABLE POPULATIONS: PEOPLE WITH SPECIAL HEALTH-CARE NEEDS

Atlanta; Sue Grinnell, Office Director, Community Wellness and Prevention, of the Washington State Department of Health; David Guzick, Dean of the University of Rochester School of Medicine and Dentistry in Rochester, New York; Robert Meenan, Dean of Boston University School of Public Health in Boston; Randy Schwartz, Senior Vice President for Strategic Health Initiatives, American Cancer Society, New England Division; Harrison Spencer, President and CEO of ASPH; Ciro Sumaya, Cox Endowed Chair in Medicine and former dean of Texas A&M Health Science Center School of Rural Public Health in

Public Health Systems Research in Emergency Preparedness A Review of the Literature

BACKGROUND Despite the acknowledged promise of developing a public health systems research (PHSR) agenda for emergency preparedness, there has been no systematic review of the literature in this area. The purpose of this study was to conduct a systematic literature review in order to identify and characterize the PHSR literature produced in the U.S. in the past 11 years in the field of public health emergency preparedness. EVIDENCE ACQUISITION Articles were searched in MEDLINE and EMBASE, as well as in the gray literature. Two independent reviewers classified the articles according to study design and IOM public health emergency preparedness (PHEP) research goal areas. EVIDENCE SYNTHESIS From January 1, 1997, through December 31, 2008, there were 547 articles that met the inclusion criteria that were published. It was possible to classify 314 (57%) articles into at least one of the four IOM PHEP research goal areas. Of these, 61 (11%) addressed Research Area 1 (usefulness of training); 39 (7%) addressed Research Area 2 (communications in preparedness and response); 193 (35%) addressed Research Area 3 (sustainable preparedness and response systems); and 39 (7%) addressed Research Area 4 (criteria and metrics to measure effectiveness and efficiency). Twenty-one studies (4%) could be classified into more than one category. The majority of the articles (81%), including commentaries/reviews and case studies, were based on qualitative analysis. Commentaries/review articles were the most common study types (62%). CONCLUSIONS Since 2001, the PHSR literature on PHEP issues has grown at about 33% per year. However, most studies lack a rigorous design, raising questions about the validity of the results.

Communications in Public Health Emergency Preparedness: A Systematic Review of the Literature

During a public health crisis, public health agencies engage in a variety of public communication efforts to inform the population, encourage the adoption of preventive behaviors, and limit the impact of adverse events. Given the importance of communication to the public in public health emergency preparedness, it is critical to examine the extent to which this field of study has received attention from the scientific community. We conducted a systematic literature review to describe current research in the area of communication to the public in public health emergency preparedness, focusing on the association between sociodemographic and behavioral factors and communication as well as preparedness outcomes. Articles were searched in PubMed and Embase and reviewed by 2 independent reviewers. A total of 131 articles were included for final review. Fifty-three percent of the articles were empirical, of which 74% were population-based studies, and 26% used information environment analysis techniques. None had an experimental study design. Population-based studies were rarely supported by theoretical models and mostly relied on a cross-sectional study design. Consistent results were reported on the association between population socioeconomic factors and public health emergency preparedness communication and preparedness outcomes. Our findings show the need for empirical research to determine what type of communication messages can be effective in achieving preparedness outcomes across various population groups. They suggest that a real-time analysis of the information environment is valuable in knowing what is being communicated to the public and could be used for course correction of public health messages during a crisis.

The Evidence Base for Effectiveness of Preparedness Training: A Retrospective Analysis

Objectives. In 2007, the Centers for Disease Control and Prevention (CDC) commissioned an Evidence-Based Gaps Collaboration Group to consider whether past experience could help guide future efforts to educate and train public health workers in responding to emergencies and disasters. Methods. The Group searched the peer-reviewed literature for preparedness training articles meeting three criteria: publication during the period when CDCs Centers for Public Health Preparedness were fully operational, content relevant to emergency response operations, and content particular to the emergency response roles of public health professionals. Articles underwent both quantitative and qualitative analyses. Results. The search identified 163 articles covering the topics of leadership and command structure (18.4%), information and communications (14.1%), organizational systems (78.5%), and others (23.9%). The number of reports was substantial, but their usefulness for trainers and educators was rated only “fair” to “good.” Thematic analysis of 137 articles found that organizational topics far outnumbered leadership, command structure, and communications topics. Disconnects among critical participants—including trainers, policy makers, and public health agencies—were noted. Generalizable evaluations were rare. Conclusions. Reviews of progress in preparedness training for the public health workforce should be repeated in the future. Governmental investment in training for preparedness should continue. Future training programs should be grounded in policy and practice needs, and evaluations should be based on performance improvement.

What have we learned about communication inequalities during the H1N1 pandemic: a systematic review of the literature

BackgroundDuring public health emergencies, public officials are busy in developing communication strategies to protect the population from existing or potential threats. However, a population’s social and individual determinants (i.e. education, income, race/ethnicity) may lead to inequalities in individual or group-specific exposure to public health communication messages, and in the capacity to access, process, and act upon the information received by specific sub-groups- a concept defined as communication inequalities.The aims of this literature review are to: 1) characterize the scientific literature that examined issues related to communication to the public during the H1N1 pandemic, and 2) summarize the knowledge gained in our understanding of social determinants and their association with communication inequalities in the preparedness and response to an influenza pandemic.MethodsArticles were searched in eight major communication, social sciences, and health and medical databases of scientific literature and reviewed by two independent reviewers by following the PRISMA guidelines. The selected articles were classified and analyzed in accordance with the Structural Influence Model of Public Health Emergency Preparedness Communications.ResultsA total of 118 empirical studies were included for final review. Among them, 78% were population-based studies and 22% were articles that employed information environment analyses techniques. Consistent results were reported on the association between social determinants of communication inequalities and emergency preparedness outcomes. Trust in public officials and source of information, worry and levels of knowledge about the disease, and routine media exposure as well as information-seeking behaviors, were related to greater likelihood of adoption of recommended infection prevention practices. When addressed in communication interventions, these factors can increase the effectiveness of the response to pandemics.ConclusionsConsistently across studies, a number of potential predictors of behavioral compliance to preventive recommendations during a pandemic were identified. Our findings show the need to include such evidence found in the development of future communication campaigns to ensure the highest rates of compliance with recommended protection measures and reduce communication inequalities during future emergencies.

A Consensus Process on the Use of Exercises and After Action Reports to Assess and Improve Public Health Emergency Preparedness and Response

INTRODUCTION The objective of disaster preparedness is to ensure that appropriate systems, procedures, and resources are in place to provide prompt, effective assistance to disaster victims, thus facilitating relief measures and rehabilitation of services. Disaster preparedness efforts include the identification of possible health scenarios based on the probability of hazards and vulnerability of the population as a basis for creating a disaster plan. Exercises that simulate emergency response, involving the health and other sectors, have been suggested as useful tools to test the plans on a regular basis and measure preparedness efforts; the absence of actual testing is likely to negate even the best of abstract plans. Problem Exercises and after action reports (AARs) are used to document preparedness activities. However, to date, limited analysis has been performed on what makes an exercise an effective tool to assess public health emergency preparedness (PHEP), and how AARs can be developed and used to support PHEP improvement efforts. The scope of this project was to achieve consensus on: (1) what makes an exercise an effective tool to assess PHEP; and (2) what makes an AAR an effective tool to guide PHEP improvement efforts. METHODS Sixty-one PHEP experts were convened by the use of Nominal Group Techniques to achieve consensus on a series of characteristics that exercises should have when designed to assess PHEP and on the recommendations for developing high-quality AARs. RESULTS The panelists achieved consensus on a list of recommendations to improve the use of exercises and AARs in PHEP improvement efforts. Such recommendations ranged from the characteristics of the exercise audience to the evaluation methodology being used and the characteristics of the produced AAR such as its structure and content. CONCLUSIONS The characteristics of the exercise audience, scenario and scope are among the most important attributes to the effectiveness of an exercise conducted for PHEP evaluation purposes. The evaluation instruments used to gather observations need an appropriate matching between exercise objectives and the response capabilities tested during the exercise, to build the base for the production of a good AAR. Improvements in the design and creation of exercises and AARs could facilitate better reporting and measurement of preparedness outcomes.

Development of a survey instrument to measure connectivity to evaluate national public health preparedness and response performance.

Objective. Survey instruments for evaluating public health preparedness have focused on measuring the structure and capacity of local, state, and federal agencies, rather than linkages among structure, process, and outcomes. To focus evaluation on the latter, we evaluated the linkages among individuals, organizations, and systems using the construct of “connectivity” and developed a measurement instrument. Methods. Results from focus groups of emergency preparedness first responders generated 62 items used in the development sample of 187 respondents. Item reduction and factors analyses were conducted to confirm the scales components. Results. The 62 items were reduced to 28. Five scales explained 70% of the total variance (number of items, percent variance explained, Cronbachs alpha) including connectivity with the system (8, 45%, 0.94), coworkers (7, 7%, 0.91), organization (7, 12%, 0.93), and perceptions (6, 6%, 0.90). Discriminant validity was found to be consistent with the factor structure. Conclusion. We developed a Connectivity Measurement Tool for the public health workforce consisting of a 34-item questionnaire found to be a reliable measure of connectivity with preliminary evidence of construct validity.