Emily M. Becker-Haimes

A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol

BackgroundThis randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods.Methods/designThis trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews.DiscussionResults will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice.Trial registrationNCT02820623, June 3rd, 2016.

Predictors of clinician use of exposure therapy in community mental health settings

Exposure therapy is recognized as the key component of cognitive-behavioral treatment for anxiety. However, exposure is the least used evidence-based treatment in community mental health settings and is the most challenging technique for clinicians to adopt within the context of effectiveness and implementation trials. Little work has examined clinician and organizational characteristics that predict use of exposure, which is important for identifying implementation strategies that may increase its use. In a large sample of community health clinicians (N=335) across 31 clinical practice sites, this study characterized clinician and organizational predictors of exposure use and relaxation for anxiety. Mixed effects regression analyses indicated that both clinician attitudes and an organizations implementation climate may be important levers for interventions seeking to increase clinician exposure use. Greater clinician use of relaxation strategies was also associated with less exposure use. Results point to important implications for implementing cognitive-behavioral therapy for anxiety, including de-emphasizing relaxation and attending to organizational climate.

Concordance Between Administrator and Clinician Ratings of Organizational Culture and Climate

Organizational culture and climate are important determinants of behavioral health service delivery for youth. The Organizational Social Context measure is a well validated assessment of organizational culture and climate that has been developed and extensively used in public sector behavioral health service settings. The degree of concordance between administrators and clinicians in their reports of organizational culture and climate may have implications for research design, inferences, and organizational intervention. However, the extent to which administrators’ and clinicians’ reports demonstrate concordance is just beginning to garner attention in public behavioral health settings in the United States. We investigated the concordance between 73 administrators (i.e., supervisors, clinical directors, and executive directors) and 247 clinicians in 28 child-serving programs in a public behavioral health system. Findings suggest that administrators, compared to clinicians, reported more positive cultures and climates. Organizational size moderated this relationship such that administrators in small programs (<466 youth clients served annually) provided more congruent reports of culture and climate in contrast to administrators in large programs (≥466 youth clients served annually) who reported more positive cultures and climates than clinicians. We propose a research agenda that examines the effect of concordance between administrators and clinicians on organizational outcomes in public behavioral health service settings.

Parent–youth informant disagreement: Implications for youth anxiety treatment

Greater parent–youth disagreement on youth symptomatology is associated with a host of factors (e.g., parental psychopathology, family functioning) that might impede treatment. Parent–youth disagreement may represent an indicator of treatment prognosis. Using data from the Child/Adolescent Anxiety Multimodal Study, this study used polynomial regression and longitudinal growth modeling to examine whether parent–youth agreement prior to and throughout treatment predicted treatment outcomes (anxiety severity, youth functioning, responder status, and diagnostic remission, rated by an independent evaluator). When parents reported more symptoms than youth prior to treatment, youth were less likely to be diagnosis-free post-treatment; this was only true if the youth received cognitive-behavioral therapy (CBT) alone, not if youth received medication, combination, or placebo treatment. Increasing concordance between parents and youth over the course of treatment was associated with better treatment outcomes across all outcome measures (ps < .001). How parents and youth “co-report” appears to be an indicator of CBT outcome. Clinical implications and future directions are discussed.

The relationship between consumer, clinician, and organizational characteristics and use of evidence-based and non-evidence-based therapy strategies in a public mental health system

We investigated the relationship between consumer, clinician, and organizational factors and clinician use of therapy strategies within a system-wide effort to increase the use of cognitive-behavioral therapy. Data from 247 clinicians in 28 child-serving organizations were collected. Clinicians participating in evidence-based practice training initiatives were more likely to report using cognitive-behavioral therapy when they endorsed more clinical experience, being salaried clinicians, and more openness to evidence-based practice. Clinicians participating in evidence-based practice initiatives were more likely to use psychodynamic techniques when they had older clients, less knowledge about evidence-based practice, more divergent attitudes toward EBP, higher financial strain, and worked in larger organizations. In clinicians not participating in evidence-based training initiatives; depersonalization was associated with higher use of cognitive-behavioral; whereas clinicians with less knowledge of evidence-based practices were more likely to use psychodynamic techniques. This study suggests that clinician characteristics are important when implementing evidence-based practices; and that consumer, clinician, and organizational characteristics are important when de-implementing non evidence-based practices. This work posits potential characteristics at multiple levels to target with implementation and deimplementation strategies.

Individualized Progress Measures Are More Acceptable to Clinicians Than Standardized Measures: Results of a National Survey

Despite research supporting measurement-based care grounded in standardized progress measures, such measures are underutilized by clinicians. Individualized measures of client-specific targets present an alternative, but little is known about their acceptability or use. We compared attitudes toward and use of standardized and individualized progress measures in a national sample of 504 clinicians. Clinicians reported neutral to positive attitudes toward both types of measures, but strongly preferred and were more likely to use individualized measures. Clinician attitudes, theoretical orientation, and work setting predicted assessment preferences and practices. Implications for dissemination and implementation of measurement-based care are discussed.

Feasibility and Acceptability of a Toolkit to Facilitate Clinician Use of Exposure Therapy for Youth

ABSTRACT Exposure therapy is a key element of cognitive-behavioral therapy for youth with anxiety. However, few clinicians outside of specialty anxiety clinics routinely use exposures with anxious youth. This study reports on the acceptability and feasibility of a clinician support toolkit for exposures with anxious youth in community settings. The toolkit was developed through an extensive literature review of exposure science and cited barriers to exposure therapy, with input from multiple experts in pediatric anxiety (n = 10). Acceptability and feasibility data were gathered via survey from 70 community clinicians attending a training on exposure therapy for youth. Qualitative data were collected from a subset of participants who used the toolkit with youth on their caseload for approximately 1 month. Survey data suggested that the toolkit was viewed highly favorably. Qualitative interviews indicated that the toolkit was viewed as a feasible therapeutic tool that positively impacted clinician motivation to use exposure. Primary challenges related to exposure use more generally and included client and service-setting barriers. Results suggested initial toolkit acceptability and feasibility. Future work to refine the toolkit and test its efficacy as an implementation strategy to increase clinician use of exposure therapy is warranted. Next steps include development of additional content in partnership with key stakeholders and testing the toolkit’s impact on increasing clinician use of exposure therapy.

Understanding the Landscape of Behavioral Health Pre-service Training to Inform Evidence-Based Intervention Implementation

Reports on the behavioral health workforce highlight the need to enhance evidence-based capacity; evidence-based interventions incorporated into pre-service graduate curricula (coursework and fieldwork) are needed to meet this goal. Improving educational practices across pre-service settings will require understanding of and careful attention to the contextual factors that exert pressure on curricula. The authors believe efforts to change educational practices can be enhanced by application of implementation science principles. This Open Forum delineates the key contextual factors that influence pre-service education, highlights gaps in the literature, and proposes an agenda for future research at the intersection of behavioral health workforce development and implementation science.

The Relationship Between Anger and Anxiety Symptoms in Youth With Anxiety Disorders

This study examined the relationship between anger and anxiety in youth in an outpatient anxiety treatment clinic. Participants included 40 primarily female and Caucasian youth, all diagnosed with a primary anxiety disorder. Youth provided ratings of anger, anxiety, and depressive symptoms. We also obtained parent and clinician ratings of anxiety severity. Analyses supported a significant relationship between trait anger and anxiety severity. When rated by youth, trait anger was significantly related to physical symptoms of anxiety and harm avoidance. Youth report of anger symptoms was not related to parent or clinician report of youth anxiety severity. Assessing symptoms of anger in youth with anxiety disorders may be important, as it may be related to higher anxiety symptom severity for some youth. Future research in larger samples is needed to understand the co-occurrence of different components of anger and anxiety disorders and its impact on prognosis and treatment process.

Transforming mental health delivery through behavioral economics and implementation science: A project protocol (Preprint)

Background Efficacious psychiatric treatments are not consistently deployed in community practice, and clinical outcomes are attenuated compared with those achieved in clinical trials. A major focus for mental health services research is to develop effective and cost-effective strategies that increase the use of evidence-based assessment, prevention, and treatment approaches in community settings. Objective The goal of this program of research is to apply insights from behavioral economics and participatory design to advance the science and practice of implementing evidence-based practice (EBP) for individuals with psychiatric disorders across the life span. Methods Project 1 (Assisting Depressed Adults in Primary care Treatment [ADAPT]) is patient-focused and leverages decision-making heuristics to compare ways to incentivize adherence to antidepressant medications in the first 6 weeks of treatment among adults newly diagnosed with depression. Project 2 (App for Strengthening Services In Specialized Therapeutic Support [ASSISTS]) is provider-focused and utilizes normative pressure and social status to increase data collection among community mental health workers treating children with autism. Project 3 (Motivating Outpatient Therapists to Implement: Valuing a Team Effort [MOTIVATE]) explores how participatory design can be used to design organizational-level implementation strategies to increase clinician use of EBPs. The projects are supported by a Methods Core that provides expertise in implementation science, behavioral economics, participatory design, measurement, and associated statistical approaches. Results Enrollment for project ADAPT started in 2018; results are expected in 2020. Enrollment for project ASSISTS will begin in 2019; results are expected in 2021. Enrollment for project MOTIVATE started in 2018; results are expected in 2019. Data collection had begun for ADAPT and MOTIVATE when this protocol was submitted. Conclusions This research will advance the science of implementation through efforts to improve implementation strategy design, measurement, and statistical methods. First, we will test and refine approaches to collaboratively design implementation strategies with stakeholders (eg, discrete choice experiments and innovation tournaments). Second, we will refine the measurement of mechanisms related to heuristics used in decision making. Third, we will develop new ways to test mechanisms in multilevel implementation trials. This trifecta, coupled with findings from our 3 exploratory projects, will lead to improvements in our knowledge of what causes successful implementation, what variables moderate and mediate the effects of those causal factors, and how best to leverage this knowledge to increase the quality of care for people with psychiatric disorders. Trial Registration ClinicalTrials.gov NCT03441399; https://www.clinicaltrials.gov/ct2/show/NCT03441399 (Archived by WebCite at http://www.webcitation.org/74dRbonBD) International Registered Report Identifier (IRRID) DERR1-10.2196/12121