Michael W. Schooley

Public health program capacity for sustainability: a new framework

BackgroundPublic health programs can only deliver benefits if they are able to sustain activities over time. There is a broad literature on program sustainability in public health, but it is fragmented and there is a lack of consensus on core constructs. The purpose of this paper is to present a new conceptual framework for program sustainability in public health.MethodsThis developmental study uses a comprehensive literature review, input from an expert panel, and the results of concept-mapping to identify the core domains of a conceptual framework for public health program capacity for sustainability. The concept-mapping process included three types of participants (scientists, funders, and practitioners) from several public health areas (e.g., tobacco control, heart disease and stroke, physical activity and nutrition, and injury prevention).ResultsThe literature review identified 85 relevant studies focusing on program sustainability in public health. Most of the papers described empirical studies of prevention-oriented programs aimed at the community level. The concept-mapping process identified nine core domains that affect a program’s capacity for sustainability: Political Support, Funding Stability, Partnerships, Organizational Capacity, Program Evaluation, Program Adaptation, Communications, Public Health Impacts, and Strategic Planning. Concept-mapping participants further identified 93 items across these domains that have strong face validity—89% of the individual items composing the framework had specific support in the sustainability literature.ConclusionsThe sustainability framework presented here suggests that a number of selected factors may be related to a program’s ability to sustain its activities and benefits over time. These factors have been discussed in the literature, but this framework synthesizes and combines the factors and suggests how they may be interrelated with one another. The framework presents domains for public health decision makers to consider when developing and implementing prevention and intervention programs. The sustainability framework will be useful for public health decision makers, program managers, program evaluators, and dissemination and implementation researchers.

State smoking prevalence estimates: a comparison of the Behavioral Risk Factor Surveillance System and current population surveys.

OBJECTIVES This study examined whether there are systematic differences between the Behavioral Risk Factor Surveillance System (BRFSS) and the Current Population Survey (CPS) for state cigarette smoking prevalence estimates. METHODS BRFSS telephone survey estimates were compared with estimates from the US Census CPS tobacco-use supplements (the CPS sample frame includes persons in households without telephones). Weighted overall and sex- and race-specific BRFSS and CPS state estimates of adults smoking were analyzed for 1985, 1989, and 1992/1993. RESULTS Overall estimates of smoking prevalence from the BRFSS were slightly lower than estimates from CPS (median difference: -2.0 percentage points in 1985, -0.7 in 1989, and -1.9 in 1992/1993; P < .05 for all comparisons), but there was variation among states. Differences between BRFSS and CPS estimates were larger among men than among women and larger among Blacks than among Hispanics or Whites; for most states, these differences were not significant. CONCLUSIONS The BRFSS generally provides state estimates of smoking prevalence similar to those obtained from CPS, and these are appropriate for ongoing state surveillance of smoking prevalence.

Challenges and strategies in applying performance measurement to federal public health programs

Performance measurement is widely accepted in public health as an important management tool supporting program improvement and accountability. However, several challenges impede developing and implementing performance measurement systems at the federal level, including the complexity of public health problems that reflect multiple determinants and involve outcomes that may take years to achieve, the decentralized and networked nature of public health program implementation, and the lack of reliable and consistent data sources and other issues related to measurement. All three of these challenges hinder the ability to attribute program results to specific public health program efforts. The purpose of this paper is to explore these issues in detail and offer potential solutions that support the development of robust and practical performance measures to meet the needs for program improvement and accountability. Adapting performance measurement to public health programs is both an evolving science and art. Through the strategies presented here, appropriate systems can be developed and monitored to support the production of meaningful data that will inform effective decision making at multiple levels.

Monitoring the tobacco use epidemic I. Overview: optimizing measurement to facilitate change.

OBJECTIVE This Overview paper (I of V) summarizes research work to date on monitoring the tobacco use epidemic, discusses the recommendations made at the November, 2002 National Tobacco Monitoring, Research and Evaluation Workshop sponsored by the U.S. National Cancer Institute (NCI), Centers for Disease Control and Prevention (CDC), the American Legacy Foundation, and the Robert Wood Johnson Foundation on the topic of tobacco surveillance and evaluation, and discusses the current state of affairs. METHODS A conceptual model based on the classical infectious diseases framework/paradigm focusing on the Agent, Host, Vector and Environment is used to integrate the work presented in the four other papers that appear in this supplemental issue of Preventive Medicine. RESULTS The Agent paper (II) describes surveillance on tobacco products and biomarkers; the Host paper (III) describes surveillance on the smoker/user, or potential smoker/user; the Vector paper (IV) describes monitoring of industry activity; and the Environment paper (V) describes several key strategies for monitoring influential environmental factors. Overall, some improvements to the nations surveillance system have been made in recent years. However, additional steps are needed to optimize measurement of tobacco use and factors influencing use in the United States. CONCLUSIONS Tobacco monitoring efforts play a vital role in combating the epidemic of addiction and disease produced by various tobacco products. The knowledge and experience gained by the tobacco use prevention and control community through this commitment to linkages of data collected in the domains of Vector and Environment, in addition to Agent and Host, could inform monitoring of a wide range of other public health issues as well, including diet and nutrition, physical activity, overweight and obesity, and substance abuse.

Seeking Best Practices: A Conceptual Framework for Planning and Improving Evidence-Based Practices

How can we encourage ongoing development, refinement, and evaluation of practices to identify and build an evidence base for best practices? On the basis of a review of the literature and expert input, we worked iteratively to create a framework with 2 interrelated components. The first — public health impact — consists of 5 elements: effectiveness, reach, feasibility, sustainability, and transferability. The second — quality of evidence — consists of 4 levels, ranging from weak to rigorous. At the intersection of public health impact and quality of evidence, a continuum of evidence-based practice emerges, representing the ongoing development of knowledge across 4 stages: emerging, promising, leading, and best. This conceptual framework brings together important aspects of impact and quality to provide a common lexicon and criteria for assessing and strengthening public health practice. We hope this work will invite and advance dialogue among public health practitioners and decision makers to build and strengthen a diverse evidence base for public health programs and strategies.