Stephanie Zaza

Grading quality of evidence and strength of recommendations.

Abstract Users of clinical practice guidelines and other recommendations need to know how much confidence they can place in the recommendations. Systematic and explicit methods of making judgments can reduce errors and improve communication. We have developed a system for grading the quality of evidence and the strength of recommendations that can be applied across a wide range of interventions and contexts. In this article we present a summary of our approach from the perspective of a guideline user. Judgments about the strength of a recommendation require consideration of the balance between benefits and harms, the quality of the evidence, translation of the evidence into specific circumstances, and the certainty of the baseline risk. It is also important to consider costs (resource utilisation) before making a recommendation. Inconsistencies among systems for grading the quality of evidence and the strength of recommendations reduce their potential to facilitate critical appraisal and improve communication of these judgments. Our system for guiding these complex judgments balances the need for simplicity with the need for full and transparent consideration of all important issues. Clinical guidelines are only as good as the evidence and judgments they are based on. The GRADE approach aims to make it easier for users to assess the judgments behind recommendations

Reviews of evidence regarding interventions to reduce alcohol-impaired driving☆

BACKGROUND Alcohol-related motor vehicle crashes are a major public health problem, resulting in 15,786 deaths and more than 300,000 injuries in 1999. This report presents the results of systematic reviews of the effectiveness and economic efficiency of selected population-based interventions to reduce alcohol-impaired driving. METHODS The Guide to Community Preventive Servicess methods for systematic reviews were used to evaluate the effectiveness of five interventions to decrease alcohol-impaired driving, using changes in alcohol-related crashes as the primary outcome measure. RESULTS Strong evidence was found for the effectiveness of .08 blood alcohol concentration laws, minimum legal drinking age laws, and sobriety checkpoints. Sufficient evidence was found for the effectiveness of lower blood alcohol concentration laws for young and inexperienced drivers and of intervention training programs for servers of alcoholic beverages. Additional information is provided about the applicability, other effects, and barriers to implementation of these interventions. CONCLUSION These reviews form the basis of the recommendations by the Task Force on Community Preventive Services presented elsewhere in this supplement. They can help decision makers identify and implement effective interventions that fit within an overall strategy to prevent impaired driving.

Data collection instrument and procedure for systematic reviews in the guide to community preventive services1

INTRODUCTION A standardized abstraction form and procedure was developed to provide consistency, reduce bias, and improve validity and reliability in the Guide to Community Preventive Services: Systematic Reviews and Evidence-Based Recommendations (the Guide). DATA COLLECTION INSTRUMENT The content of the abstraction form was based on methodologies used in other systematic reviews; reporting standards established by major health and social science journals; the evaluation, statistical and meta-analytic literature; expert opinion and review; and pilot-testing. The form is used to classify and describe key characteristics of the intervention and evaluation (26 questions) and assess the quality of the studys execution (23 questions). Study procedures and results are collected and specific threats to the validity of the study are assessed across six categories (intervention and study descriptions, sampling, measurement, analysis, interpretation of results and other execution issues). DATA COLLECTION PROCEDURES Each study is abstracted by two independent reviewers and reconciled by the chapter development team. Reviewers are trained and provided with feedback. DISCUSSION What to abstract and how to summarize the data are discretionary choices that influence conclusions drawn on the quality of execution of the study and its effectiveness. The form balances flexibility for the evaluation of papers with different study designs and intervention types with the need to ask specific questions to maximize validity and reliability. It provides a structured format that researchers and others can use to review the content and quality of papers, conduct systematic reviews, or develop manuscripts. A systematic approach to developing and evaluating manuscripts will help to promote overall improvement of the scientific literature.

Reviews of evidence regarding interventions to increase the use of safety belts

BACKGROUND The use of safety belts is the single most effective means of reducing fatal and nonfatal injuries in motor vehicle crashes. If all motor vehicle occupants consistently wore safety belts, an estimated 9553 deaths would have been prevented in 1999 alone. METHODS The Guide to Community Preventive Servicess methods for systematic reviews were used to evaluate the effectiveness of three interventions to increase safety belt use. Effectiveness was assessed on the basis of changes in safety belt use and number of crash-related injuries. RESULTS Strong evidence was found for the effectiveness of safety belt laws in general and for the incremental effectiveness of primary safety belt laws relative to secondary laws. Strong evidence for the effectiveness of enhanced enforcement programs for safety belt laws was also found. Additional information is provided about the applicability, other effects, and barriers to implementation of these interventions. CONCLUSIONS These reviews form the basis of the recommendations by the Task Force on Community Preventive Services presented elsewhere in this supplement. They can help decision makers identify and implement effective interventions that fit within an overall strategy to increase safety belt use.

REVIEWS OF EVIDENCE REGARDING INTERVENTIONS TO INCREASE USE OF CHILD SAFETY SEATS

BACKGROUND In 1998, nearly 600 child occupants of motor vehicles aged younger than 4 years died in motor vehicle crashes. Yet approximately 29% of children aged 4 years and younger do not ride in appropriate child safety seat restraints, which, when correctly installed and used, reduce the need for hospitalization in this age group by 69% and the risk of death by approximately 70% for infants and by 47% to 54% for toddlers (aged 1 to 4 years). METHODS The systematic review development team reviewed the scientific evidence of effectiveness for five interventions to increase child safety seat use. For each intervention, changes in the use of child safety seats or injury rates were the outcome measures evaluated to determine the success of the intervention. Database searching was concluded in March 1998. More than 3500 citations were screened; of these citations, 72 met the inclusion criteria for the reviews. RESULTS The systematic review process identified strong evidence of effectiveness for child safety seat laws and distribution plus education programs. In addition, community-wide information plus enhanced enforcement campaigns and incentive plus education programs had sufficient evidence of effectiveness. Insufficient evidence was identified for education-only programs aimed at parents, young children, healthcare professionals, or law enforcement personnel. CONCLUSIONS Evidence is available about the effectiveness of four of the five interventions we reviewed. This scientific evidence, along with the accompanying recommendations of the Task Force elsewhere in this supplement, can be a powerful tool for securing the resources and commitment required to implement these strategies.

Methods for Systematic Reviews of Economic Evaluations for the Guide to Community Preventive Services

OBJECTIVES This paper describes the methods used in the Guide to Community Preventive Services: Systematic Reviews and Evidence-Based Recommendations (the Guide) for conducting systematic reviews of economic evaluations across community health-promotion and disease-prevention interventions. The lack of standardized methods to improve the comparability of results from economic evaluations has hampered the use of data on costs and financial benefits in evidence-based reviews of effectiveness. The methods and instruments developed for the Guide provide an explicit and systematic approach for abstracting economic evaluation data and increase the usefulness of economic information for policy making in health care and public health. METHODS The following steps were taken for systematic reviews of economic evaluations: (1) systematic searches were conducted; (2) studies using economic analytic methods, such as cost analysis or cost-effectiveness, cost-benefit or cost-utility analysis, were selected according to explicit inclusion criteria; (3) economic data were abstracted and adjusted using a standardized abstraction form; and (4) adjusted summary measures were listed in summary tables. RESULTS These methods were used in a review of 10 interventions designed to improve vaccination coverage in children, adolescents and adults. Ten average costs and 14 cost-effectiveness ratios were abstracted or calculated from data reported in 24 studies and expressed in 1997 USD. The types of costs included in the analysis and intervention definitions varied extensively. Gaps in data were found for many interventions.

Developing the guide to community preventive services—overview and rationale

When the GUIDE TO COMMUNITY PREVENTIVE SERVICES: Systematic Reviews and Evidence-Based Recommendations (the Guide) is published in 2001, it will represent a significant national effort in encouraging evidence-based public health practice in defined populations (e.g., communities or members of specific managed care plans). The Guide will make recommendations regarding public health interventions to reduce illness, disability, premature death, and environmental hazards that impair community health and quality of life. The Guide is being developed under the guidance of the Task Force on Community Preventive Services (the Task Force)-a 15-member, nonfederal, independent panel of experts. Subject matter experts, methodologists, and scientific staff are supporting the Task Force in using explicit rules to conduct systematic literature reviews of evidence of effectiveness, economic efficiency, and feasibility on which to base recommendations for community action. Contributors to the Guide are building on the experience of others to confront methodologic challenges unique to the assessment of complex multicomponent intervention studies with nonexperimental or nonrandomized designs and diverse measures of outcome and effectiveness. Persons who plan, fund, and implement population-based services and policies to improve health at the state and local levels are invited to scrutinize the work in progress and to communicate with contributors. When the Guide is complete, readers are encouraged to consider critically the value and relevance of its contents, the implementation of interventions the Task Force recommends, the abandonment of interventions the Task Force does not recommend, and the need for rigorous evaluation of the benefits and harms of promising interventions of unknown effectiveness.

Effectiveness of Sobriety Checkpoints for Reducing Alcohol-Involved Crashes

The goal of sobriety checkpoints is to deter drinking and driving by systematically stopping drivers for assessment of alcohol impairment, thus increasing the perceived risk of arrest for alcohol-impaired driving. This review examines the effectiveness of random breath testing (RBT) checkpoints, at which all drivers stopped are given breath tests for blood alcohol levels, and selective breath testing (SBT) checkpoints, at which police must have reason to suspect the driver has been drinking before demanding a breath test. A systematic review of the effectiveness of sobriety checkpoints in reducing alcohol-involved crashes and associated injuries and fatalities was conducted using the methodology developed for the Guide to Community Preventive Services (Community Guide) . Substantial reductions in crashes were observed for both checkpoint types across various outcome measures and time periods. Results suggest that both RBT and SBT checkpoints can play an important role in preventing alcohol-related crashes and associated injuries.

The Whole School, Whole Community, Whole Child Model: A New Approach for Improving Educational Attainment and Healthy Development for Students.

BACKGROUND The Whole Child approach and the coordinated school health (CSH) approach both address the physical and emotional needs of students. However, a unified approach acceptable to both the health and education communities is needed to assure that students are healthy and ready to learn. METHODS During spring 2013, the ASCD (formerly known as the Association for Supervision and Curriculum Development) and the US Centers for Disease Control and Prevention (CDC) convened experts from the field of education and health to discuss lessons learned from implementation of the CSH and Whole Child approaches and to explore the development of a new model that would incorporate the knowledge gained through implementation to date. RESULTS As a result of multiple discussions and review, the Whole School, Whole Community, Whole Child (WSCC) approach was developed. The WSCC approach builds upon the traditional CSH model and ASCDs Whole Child approach to learning and promotes greater alignment between health and educational outcomes. CONCLUSION By focusing on children and youth as students, addressing critical education and health outcomes, organizing collaborative actions and initiatives that support students, and strongly engaging community resources, the WSCC approach offers important opportunities that will improve educational attainment and healthy development for students.

Sexual Identity, Sex of Sexual Contacts, and Health-Related Behaviors Among Students in Grades 9–12 — United States and Selected Sites, 2015

PROBLEM Sexual identity and sex of sexual contacts can both be used to identify sexual minority youth. Significant health disparities exist between sexual minority and nonsexual minority youth. However, not enough is known about health-related behaviors that contribute to negative health outcomes among sexual minority youth and how the prevalence of these health-related behaviors compare with the prevalence of health-related behaviors among nonsexual minorities. REPORTING PERIOD September 2014-December 2015. DESCRIPTION OF THE SYSTEM The Youth Risk Behavior Surveillance System (YRBSS) monitors six categories of priority health-related behaviors among youth and young adults: 1) behaviors that contribute to unintentional injuries and violence; 2) tobacco use; 3) alcohol and other drug use; 4) sexual behaviors related to unintended pregnancy and sexually transmitted infections, including human immunodeficiency virus infection; 5) unhealthy dietary behaviors; and 6) physical inactivity. In addition, YRBSS monitors the prevalence of obesity and asthma and other priority health-related behaviors. YRBSS includes a national school-based Youth Risk Behavior Survey (YRBS) conducted by CDC and state and large urban school district school-based YRBSs conducted by state and local education and health agencies. For the 2015 YRBSS cycle, a question to ascertain sexual identity and a question to ascertain sex of sexual contacts was added for the first time to the national YRBS questionnaire and to the standard YRBS questionnaire used by the states and large urban school districts as a starting point for their YRBS questionnaires. This report summarizes results for 118 health-related behaviors plus obesity, overweight, and asthma by sexual identity and sex of sexual contacts from the 2015 national survey, 25 state surveys, and 19 large urban school district surveys conducted among students in grades 9-12. RESULTS Across the 18 violence-related risk behaviors nationwide, the prevalence of 16 was higher among gay, lesbian, and bisexual students than heterosexual students and the prevalence of 15 was higher among students who had sexual contact with only the same sex or with both sexes than students who had sexual contact with only the opposite sex. Across the 13 tobacco use-related risk behaviors, the prevalence of 11 was higher among gay, lesbian, and bisexual students than heterosexual students and the prevalence of 10 was higher among students who had sexual contact with only the same sex or with both sexes than students who had sexual contact with only the opposite sex. Similarly, across the 19 alcohol or other drug use-related risk behaviors, the prevalence of 18 was higher among gay, lesbian, and bisexual students than heterosexual students and the prevalence of 17 was higher among students who had sexual contact with only the same sex or with both sexes than students who had sexual contact with only the opposite sex. This pattern also was evident across the six sexual risk behaviors. The prevalence of five of these behaviors was higher among gay, lesbian, and bisexual students than heterosexual students and the prevalence of four was higher among students who had sexual contact with only the same sex or with both sexes than students who had sexual contact with only the opposite sex. No clear pattern of differences emerged for birth control use, dietary behaviors, and physical activity. INTERPRETATION The majority of sexual minority students cope with the transition from childhood through adolescence to adulthood successfully and become healthy and productive adults. However, this report documents that sexual minority students have a higher prevalence of many health-risk behaviors compared with nonsexual minority students. PUBLIC HEALTH ACTION To reduce the disparities in health-risk behaviors among sexual minority students, it is important to raise awareness of the problem; facilitate access to education, health care, and evidence-based interventions designed to address priority health-risk behaviors among sexual minority youth; and continue to implement YRBSS at the national, state, and large urban school district levels to document and monitor the effect of broad policy and programmatic interventions on the health-related behaviors of sexual minority youth.