Jeffrey L. Smith

A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project

BackgroundIdentifying, developing, and testing implementation strategies are important goals of implementation science. However, these efforts have been complicated by the use of inconsistent language and inadequate descriptions of implementation strategies in the literature. The Expert Recommendations for Implementing Change (ERIC) study aimed to refine a published compilation of implementation strategy terms and definitions by systematically gathering input from a wide range of stakeholders with expertise in implementation science and clinical practice.MethodsPurposive sampling was used to recruit a panel of experts in implementation and clinical practice who engaged in three rounds of a modified Delphi process to generate consensus on implementation strategies and definitions. The first and second rounds involved Web-based surveys soliciting comments on implementation strategy terms and definitions. After each round, iterative refinements were made based upon participant feedback. The third round involved a live polling and consensus process via a Web-based platform and conference call.ResultsParticipants identified substantial concerns with 31% of the terms and/or definitions and suggested five additional strategies. Seventy-five percent of definitions from the originally published compilation of strategies were retained after voting. Ultimately, the expert panel reached consensus on a final compilation of 73 implementation strategies.ConclusionsThis research advances the field by improving the conceptual clarity, relevance, and comprehensiveness of implementation strategies that can be used in isolation or combination in implementation research and practice. Future phases of ERIC will focus on developing conceptually distinct categories of strategies as well as ratings for each strategy’s importance and feasibility. Next, the expert panel will recommend multifaceted strategies for hypothetical yet real-world scenarios that vary by sites’ endorsement of evidence-based programs and practices and the strength of contextual supports that surround the effort.

Persistently poor outcomes of undetected major depression in primary care

Despite its relevance for quality care initiatives, the field of psychiatry has little scientific knowledge regarding the course of current major depression when primary care patients with the disorder remain undetected. Using statewide telephone screening, we identified and followed 98 adults with current major depression who made one or more visits to a primary care physician during the 6 months following baseline. Thirty-two percent of primary care patients with current major depression remained undetected for up to 1 year. Almost half of undetected patients developed suicidal ideation. Less than one-third of undetected patients made a visit during the month they reported their worst symptoms. Fifty-three percent of undetected patients reported five or more current symptoms at 1 year follow-up. Primary care patients with undetected major depression report persistently poor outcomes. Comparison of outcomes with detected patients suggests that quality improvement efforts directed at improving detection without improving management of detected patients may not improve outcomes.

The effect of improving primary care depression management on employee absenteeism and productivity. A randomized trial.

Objective:To test whether an intervention to improve primary care depression management significantly improves productivity at work and absenteeism over 2 years. Setting and Subjects:Twelve community primary care practices recruiting depressed primary care patients identified in a previsit screening. Research Design:Practices were stratified by depression treatment patterns before randomization to enhanced or usual care. After delivering brief training, enhanced care clinicians provided improved depression management over 24 months. The research team evaluated productivity and absenteeism at baseline, 6, 12, 18, and 24 months in 326 patients who reported full-or part-time work at one or more completed waves. Results:Employed patients in the enhanced care condition reported 6.1% greater productivity and 22.8% less absenteeism over 2 years. Consistent with its impact on depression severity and emotional role functioning, intervention effects were more observable in consistently employed subjects where the intervention improved productivity by 8.2% over 2 years at an estimated annual value of

An introduction to implementation science for the non-specialist

1982 per depressed full-time equivalent and reduced absenteeism by 28.4% or 12.3 days over 2 years at an estimated annual value of

Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study

619 per depressed full-time equivalent. Conclusions:This trial, which is the first to our knowledge to demonstrate that improving the quality of care for any chronic disease has positive consequences for productivity and absenteeism, encourages formal cost-benefit research to assess the potential return-on-investment employers of stable workforces can realize from using their purchasing power to encourage better depression treatment for their employees.

Improving Detection of Suicidal Ideation Among Depressed Patients in Primary Care

BackgroundThe movement of evidence-based practices (EBPs) into routine clinical usage is not spontaneous, but requires focused efforts. The field of implementation science has developed to facilitate the spread of EBPs, including both psychosocial and medical interventions for mental and physical health concerns.DiscussionThe authors aim to introduce implementation science principles to non-specialist investigators, administrators, and policymakers seeking to become familiar with this emerging field. This introduction is based on published literature and the authors’ experience as researchers in the field, as well as extensive service as implementation science grant reviewers.Implementation science is “the scientific study of methods to promote the systematic uptake of research findings and other EBPs into routine practice, and, hence, to improve the quality and effectiveness of health services.” Implementation science is distinct from, but shares characteristics with, both quality improvement and dissemination methods. Implementation studies can be either assess naturalistic variability or measure change in response to planned intervention. Implementation studies typically employ mixed quantitative-qualitative designs, identifying factors that impact uptake across multiple levels, including patient, provider, clinic, facility, organization, and often the broader community and policy environment. Accordingly, implementation science requires a solid grounding in theory and the involvement of trans-disciplinary research teams.SummaryThe business case for implementation science is clear: As healthcare systems work under increasingly dynamic and resource-constrained conditions, evidence-based strategies are essential in order to ensure that research investments maximize healthcare value and improve public health. Implementation science plays a critical role in supporting these efforts.

Lessons Learned about Implementing Research Evidence into Clinical Practice

BackgroundPoor terminological consistency for core concepts in implementation science has been widely noted as an obstacle to effective meta-analyses. This inconsistency is also a barrier for those seeking guidance from the research literature when developing and planning implementation initiatives. The Expert Recommendations for Implementing Change (ERIC) study aims to address one area of terminological inconsistency: discrete implementation strategies involving one process or action used to support a practice change. The present report is on the second stage of the ERIC project that focuses on providing initial validation of the compilation of 73 implementation strategies that were identified in the first phase.FindingsPurposive sampling was used to recruit a panel of experts in implementation science and clinical practice (N = 35). These key stakeholders used concept mapping sorting and rating activities to place the 73 implementation strategies into similar groups and to rate each strategy’s relative importance and feasibility. Multidimensional scaling analysis provided a quantitative representation of the relationships among the strategies, all but one of which were found to be conceptually distinct from the others. Hierarchical cluster analysis supported organizing the 73 strategies into 9 categories. The ratings data reflect those strategies identified as the most important and feasible.ConclusionsThis study provides initial validation of the implementation strategies within the ERIC compilation as being conceptually distinct. The categorization and strategy ratings of importance and feasibility may facilitate the search for, and selection of, strategies that are best suited for implementation efforts in a particular setting.

Does a Depression Intervention Result in Improved Outcomes for Patients Presenting with Physical Symptoms

PURPOSE Primary care clinicians have difficulty detecting suicidal patients. This report evaluates the effect of 2 primary care interventions on the detection and subsequent referral or treatment of patients with depression and recent suicidal ideation. METHODS Adult patients in 12 mixed-payer primary care practices and 9 not-for-profit staff model health maintenance organization (HMO) practices were screened for depression. Matched practices were randomized within plan type to intervention or usual care. The intervention for mixed-payer practices entailed brief training of physicians and office nurses to provide care management. The intervention for HMO practices consisted of guided development of quality improvement teams for depression care. A total of 880 enrolled patients met study criteria for depression, 232 of whom met criteria for recent suicidal ideation. Intervention effects on suicide detection and referral to mental health specialty care were evaluated with mixed-effects multilevel models in intent-to-treat analyses. RESULTS Depressed patients with recent suicidal ideation were detected on 40.7% of index visits in intervention practices, compared with 20.5% in usual care practices (odds ratio = 2.64, 95% confidence interval, 1.45–5.07), with HMO plan type and male sex associated with detection. The interventions had no effect on referral of patients, starting an antidepressant, or suicidal ideation reported at a 6-month follow-up, although power was limited for all 3 analyses. CONCLUSIONS Primary care interventions to improve depression care can improve detection of recent suicidal ideation. Further work is needed to improve physician response to detection, including referral to specialty care and more aggressive treatment, and to observe the effect on outcomes.

Expert recommendations for implementing change (ERIC): protocol for a mixed methods study

The mission of the Veterans Health Administration’s (VHA) quality enhancement research initiative (QUERI) is to enhance the quality of VHA health care by implementing clinical research findings into routine care. This paper presents lessons that QUERI investigators have learned through their initial attempts to pursue the QUERI mission. The lessons in this paper represent those that were common across multiple QUERI projects and were mutually agreed on as having substantial impact on the success of implementation. While the lessons are consistent with commonly recognized ingredients of successful implementation efforts, the examples highlight the fact that, even with a through knowledge of the literature and thoughtful planning, unexpected circumstances arise during implementation efforts that require flexibility and adaptability. The findings stress the importance of utilizing formative evaluation techniques to identify barriers to successful implementation and strategies to address these barriers.

Predicting implementation from organizational readiness for change: a study protocol

OBJECTIVE: To investigate the effects of exclusively physical presentation of depression on 1) depression management and outcomes under usual care conditions, and 2) the impact of an intervention to improve management and outcomes.DESIGN AND SETTING: Secondary analysis of a depression intervention trial in 12 community-based primary care practices.PARTICIPANTS: Two hundred adults beginning a new treatment episode for depression.MEASUREMENTS: Presenting complaint and physician depression query at index visit; antidepressant use, completion of adequate antidepressant trial, change in depressive symptoms, and physical and emotional role functioning at 6 months.MAIN RESULTS: Sixty-six percent of depressed patients presented exclusively with physical symptoms. Under usual care conditions, psychological presenters were more likely than physicial presenters to complete an adequate trial of anti-depressant treatment but experienced equivalent improvements in depressive severity and role functioning. In patients presenting exclusively with physicial symptoms, the intervention significantly improved physician query (40.8% vs 18.0%; P=.06), receipt of any antidepressant (63.0% vs 20.1%; P=.001), and an adequate antidepressant trial (34.9% vs 5.9%; P=.004), but did not significantly improve depression severity or role functioning. In patients presenting with psychological symptoms, the intervention significantly improved receipt of any antidepressant (79.9% vs 38.0%; P=.01) and an adequate antidepressant trial (46.0% vs 23.8%; P=.004), and also improved depression severity and physical and emotional role functioning.CONCLUSIONS: Our results suggest that there is a differential intervention effect by presentation style at the index visit. Thus, current interventions should be targeted at psychological presenters and new approaches should be developed for physical presenters.