Brandy N. Smith

A Review of Studies on the System-Wide Implementation of Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration

Since 2006, the Veterans Health Administration (VHA) has instituted policy changes and training programs to support system-wide implementation of two evidence-based psychotherapies (EBPs) for posttraumatic stress disorder (PTSD). To assess lessons learned from this unprecedented effort, we used PubMed and the PILOTS databases and networking with researchers to identify 32 reports on contextual influences on implementation or sustainment of EBPs for PTSD in VHA settings. Findings were initially organized using the exploration, planning, implementation, and sustainment framework (EPIS; Aarons et al. in Adm Policy Ment Health Health Serv Res 38:4–23, 2011). Results that could not be adequately captured within the EPIS framework, such as implementation outcomes and adopter beliefs about the innovation, were coded using constructs from the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework (Glasgow et al. in Am J Public Health 89:1322–1327, 1999) and Consolidated Framework for Implementation Research (CFIR; Damschroder et al. in Implement Sci 4(1):50, 2009). We highlight key areas of progress in implementation, identify continuing challenges and research questions, and discuss implications for future efforts to promote EBPs in large health care systems.

Context Matters: Team and Organizational Factors Associated with Reach of Evidence-Based Psychotherapies for PTSD in the Veterans Health Administration

Evidence-based psychotherapies for PTSD are often underused. The objective of this mixed-method study was to identify organizational and clinic factors that promote high levels of reach of evidence-based psychotherapies for PTSD 10 years into their dissemination throughout the Veterans Health Administration. We conducted 96 individual interviews with staff from ten outpatient PTSD teams at nine sites that differed in reach of evidence-based psychotherapies for PTSD. Major themes associated with reach included clinic mission, clinic leader and staff engagement, clinic operations, staff perceptions, and the practice environment. Strategies to improve reach of evidence-based psychotherapies should attend to organizational and team-level factors.

Dialectical Behavior Therapy Training and Desired Resources for Implementation: Results From a National Program Evaluation in the Veterans Health Administration.

ABSTRACTContext: Little is known about nonresearch training experiences of providers who implement evidence-based psychotherapies for suicidal behaviors among veterans. Evidence Acquisition: This national program evaluation identified the history of training, training needs, and desired resources of clinicians who work with at-risk veterans in a national health care system. This sequential mixed methods national program evaluation used a post-only survey design to obtain needs assessment data from clinical sites (N = 59) within Veterans Health Administration (VHA) facilities that implemented dialectical behavior therapy (DBT). Data were also collected on resources preferred to support ongoing use of DBT. Results: While only 33% of clinical sites within VHA facilities reported that staff attended a formal DBT intensive training workshop, nearly 97% of participating sites reported having staff who completed self-study using DBT manuals. Mobile apps for therapists and clients and templates for documentation ...CONTEXT Little is known about nonresearch training experiences of providers who implement evidence-based psychotherapies for suicidal behaviors among veterans. EVIDENCE ACQUISITION This national program evaluation identified the history of training, training needs, and desired resources of clinicians who work with at-risk veterans in a national health care system. This sequential mixed methods national program evaluation used a post-only survey design to obtain needs assessment data from clinical sites (N = 59) within Veterans Health Administration (VHA) facilities that implemented dialectical behavior therapy (DBT). Data were also collected on resources preferred to support ongoing use of DBT. RESULTS While only 33% of clinical sites within VHA facilities reported that staff attended a formal DBT intensive training workshop, nearly 97% of participating sites reported having staff who completed self-study using DBT manuals. Mobile apps for therapists and clients and templates for documentation in the electronic health records to support measurement-based care were desired clinical resources. CONCLUSION Results indicate that less-intensive training models can aid staff in implementing DBT in real-world health care settings. While more training is requested, a number of VHA facilities have successfully implemented DBT into the continuum of care for veterans at risk for suicide.

Diagnostic accuracy of a two-item screen for drug use developed from the alcohol, smoking and substance involvement screening test (ASSIST)

AIMS The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) is a screening instrument to detect substance use in primary care (PC). To screen for illicit substances (excluding tobacco and alcohol), the ASSIST consists of 8-57 questions and requires complicated scoring. To improve the efficiency of screening of drug misuse in PC, this study constructed and validated a two-item screen for drug use from the ASSIST. METHODS Guided by previous reviews, the ASSIST was revised. Patients were recruited in VA primary care clinics (N=1283). Half of the sample was used to develop the ASSIST-Drug; the other half was used to validate it. The Mini International Neuropsychiatric Interview (MINI) and the Inventory of Drug Use Consequences were the criterion measures. RESULTS A brief, two-item ASSIST-Drug was constructed. Based on the development sample, the ASSIST-Drug was 94.1% sensitive and 89.6% specific for drug use disorders. Based on the validation sample, it was 95.4% sensitive and 87.8% specific. The ASSIST-Drug also had comparable sensitivity and specificity to identify drug use negative consequences, as well as for diverse subgroups of patients in terms of gender, age, race/ethnicity, marital status, educational levels, and post traumatic stress disorder status. CONCLUSIONS The ASSIST-Drug may be a useful screening tool for PC settings. It is reliable, brief, and easy to remember, administer and score. It is sensitive and specific for drug use disorders and drug use negative consequences, and the predictive properties are consistent across subgroup of patients.

Developing alternative training delivery methods to improve Psychotherapy implementation in the U.S. department of Veterans affairs

The Department of Veteran Affairs (VA) has been a recognized leader in evidence-based psychotherapy (EBP) training, with 15 different EBP training programs that address posttraumatic stress disorder (PTSD), depression, chronic pain, insomnia, substance use, motivation for treatment, relationship distress, serious mental illness, and problem-solving skills. VA has a broad impact on the training of mental health professionals in the United States, training over 11,600 unique mental health staff in 1 or more of these EBPs since 2007. Original EBP training delivery methods relied on in-person workshops, followed by consultation with an EBP expert who provided feedback and ratings of audio-recorded sessions. Restrictions on federal government employee travel, in-person conferences, and budgets led to reductions in the number of mental health providers trained in EBPs during recent fiscal years. As a result, alternative training delivery methods were needed for training VA staff. This article describes the process used to select, develop, and pilot test alternative training delivery methods for EBPs. Surveys of key stakeholders and a literature review led us to retain consultation with review of audio-recorded sessions since evidence suggests this is critical to changing clinician behavior. All VA EBP training programs have begun pilot testing blended learning, regional training, or both, depending on local needs. Early results suggest that regional training (train the trainer method) was equivalent to, while blended learning methods showed mixed results relative to, the traditional training method. These alternative training methods may be more sustainable for training psychotherapists in large health care systems or across distances.

Diagnostic accuracy of a two-item Drug Abuse Screening Test (DAST-2)

OBJECTIVE Drug use is prevalent and costly to society, but individuals with drug use disorders (DUDs) are under-diagnosed and under-treated, particularly in primary care (PC) settings. Drug screening instruments have been developed to identify patients with DUDs and facilitate treatment. The Drug Abuse Screening Test (DAST) is one of the most well-known drug screening instruments. However, similar to many such instruments, it is too long for routine use in busy PC settings. This study developed and validated a briefer and more practical DAST for busy PC settings. METHOD We recruited 1300 PC patients in two Department of Veterans Affairs (VA) clinics. Participants responded to a structured diagnostic interview. We randomly selected half of the sample to develop and the other half to validate the new instrument. We employed signal detection techniques to select the best DAST items to identify DUDs (based on the MINI) and negative consequences of drug use (measured by the Inventory of Drug Use Consequences). Performance indicators were calculated. RESULTS The two-item DAST (DAST-2) was 97% sensitive and 91% specific for DUDs in the development sample and 95% sensitive and 89% specific in the validation sample. It was highly sensitive and specific for DUD and negative consequences of drug use in subgroups of patients, including gender, age, race/ethnicity, marital status, educational level, and posttraumatic stress disorder status. CONCLUSIONS The DAST-2 is an appropriate drug screening instrument for routine use in PC settings in the VA and may be applicable in broader range of PC clinics.