Ronnie Rubin

The Perfect Storm: Collision of the Business of Mental Health and the Implementation of Evidence-Based Practices

Financing has been hypothesized to be an important driver of the implementation of evidence-based practices (EBPs), yet there has been little systematic investigation of financing as a factor in EBP implementation. This column presents findings from a qualitative study of the effects of financial factors on the implementation of EBPs in a large urban publicly funded mental health system. Interviews with 33 agency leaders and 16 policy makers identified financial distress in community mental health agencies, leading to concerns about complex and expensive implementation of EBPs. Stakeholders agreed that the cost of EBP implementation should be shared between the agencies and the system; however, the stakeholders did not agree on how EBPs should be financed.

Applying the Policy Ecology Framework to Philadelphia's Behavioral Health Transformation Efforts.

Abstract Raghavan et al. (Implement Sci 3(26):1–9, 2008) proposed that effective implementation of evidence-based practices requires implementation strategies deployed at multiple levels of the “policy ecology,” including the organizational, regulatory or purchaser agency, political, and social levels. However, much of implementation research and practice targets providers without accounting for contextual factors that may influence provider behavior. This paper examines Philadelphia’s efforts to work toward an evidence-based and recovery-oriented behavioral health system, and uses the policy ecology framework to illustrate how multifaceted, multilevel implementation strategies can facilitate the widespread implementation of evidence-based practices. Ongoing challenges and implications for research and practice are discussed.

Predictors of clinician use of exposure therapy in community mental health settings

Exposure therapy is recognized as the key component of cognitive-behavioral treatment for anxiety. However, exposure is the least used evidence-based treatment in community mental health settings and is the most challenging technique for clinicians to adopt within the context of effectiveness and implementation trials. Little work has examined clinician and organizational characteristics that predict use of exposure, which is important for identifying implementation strategies that may increase its use. In a large sample of community health clinicians (N=335) across 31 clinical practice sites, this study characterized clinician and organizational predictors of exposure use and relaxation for anxiety. Mixed effects regression analyses indicated that both clinician attitudes and an organizations implementation climate may be important levers for interventions seeking to increase clinician exposure use. Greater clinician use of relaxation strategies was also associated with less exposure use. Results point to important implications for implementing cognitive-behavioral therapy for anxiety, including de-emphasizing relaxation and attending to organizational climate.

Concordance Between Administrator and Clinician Ratings of Organizational Culture and Climate

Organizational culture and climate are important determinants of behavioral health service delivery for youth. The Organizational Social Context measure is a well validated assessment of organizational culture and climate that has been developed and extensively used in public sector behavioral health service settings. The degree of concordance between administrators and clinicians in their reports of organizational culture and climate may have implications for research design, inferences, and organizational intervention. However, the extent to which administrators’ and clinicians’ reports demonstrate concordance is just beginning to garner attention in public behavioral health settings in the United States. We investigated the concordance between 73 administrators (i.e., supervisors, clinical directors, and executive directors) and 247 clinicians in 28 child-serving programs in a public behavioral health system. Findings suggest that administrators, compared to clinicians, reported more positive cultures and climates. Organizational size moderated this relationship such that administrators in small programs (<466 youth clients served annually) provided more congruent reports of culture and climate in contrast to administrators in large programs (≥466 youth clients served annually) who reported more positive cultures and climates than clinicians. We propose a research agenda that examines the effect of concordance between administrators and clinicians on organizational outcomes in public behavioral health service settings.

Are General and Strategic Measures of Organizational Context and Leadership Associated with Knowledge and Attitudes toward Evidence-Based Practices in Public Behavioral Health Settings? A Cross-Sectional Observational Study

BackgroundExamining the role of modifiable barriers and facilitators is a necessary step toward developing effective implementation strategies. This study examines whether both general (organizational culture, organizational climate, and transformational leadership) and strategic (implementation climate and implementation leadership) organizational-level factors predict therapist-level determinants of implementation (knowledge of and attitudes toward evidence-based practices).MethodsWithin the context of a system-wide effort to increase the use of evidence-based practices (EBPs) and recovery-oriented care, we conducted an observational, cross-sectional study of 19 child-serving agencies in the City of Philadelphia, including 23 sites, 130 therapists, 36 supervisors, and 22 executive administrators. Organizational variables included characteristics such as EBP initiative participation, program size, and proportion of independent contractor therapists; general factors such as organizational culture and climate (Organizational Social Context Measurement System) and transformational leadership (Multifactor Leadership Questionnaire); and strategic factors such as implementation climate (Implementation Climate Scale) and implementation leadership (Implementation Leadership Scale). Therapist-level variables included demographics, attitudes toward EBPs (Evidence-Based Practice Attitudes Scale), and knowledge of EBPs (Knowledge of Evidence-Based Services Questionnaire). We used linear mixed-effects regression models to estimate the associations between the predictor (organizational characteristics, general and strategic factors) and dependent (knowledge of and attitudes toward EBPs) variables.ResultsSeveral variables were associated with therapists’ knowledge of EBPs. Clinicians in organizations with more proficient cultures or higher levels of transformational leadership (idealized influence) had greater knowledge of EBPs; conversely, clinicians in organizations with more resistant cultures, more functional organizational climates, and implementation climates characterized by higher levels of financial reward for EBPs had less knowledge of EBPs. A number of organizational factors were associated with the therapists’ attitudes toward EBPs. For example, more engaged organizational cultures, implementation climates characterized by higher levels of educational support, and more proactive implementation leadership were all associated with more positive attitudes toward EBPs.ConclusionsThis study provides evidence for the importance of both general and strategic organizational determinants as predictors of knowledge of and attitudes toward EBPs. The findings highlight the need for longitudinal and mixed-methods studies that examine the influence of organizational factors on implementation.

Independent Contractors in Public Mental Health Clinics: Implications for Use of Evidence-Based Practices

OBJECTIVES Community mental health clinics are increasingly utilizing independent contractors to provide clinical services. At the same time, many organizations are participating in initiatives intended to increase implementation of evidence-based practices (EBPs). The primary aim of this study was to understand the associations of utilizing independent contractors with clinician knowledge and attitudes toward EBPs and organizational culture and climate. The study also sought to understand the potential impact of using independent contractors on mental health services delivery from the perspective of organizational leadership. METHODS Quantitative data were collected from 130 therapists in 23 organizations; qualitative data were collected from executive administrators in nine of the 16 organizations participating in EBP initiatives sponsored by the City of Philadelphia. Regression with random effects was used to estimate the associations between worker status (contractor or employee) and clinician attitudes toward EBPs, knowledge of EBPs, and organizational culture and climate. Qualitative inquiry was used to understand the impact of reliance on independent contractors on organizational participation in EBP initiatives. RESULTS Independent contractors endorsed less positive attitudes toward EBPs and scored lower on knowledge of EBPs. Interviews revealed four main themes: reasons for using independent contractors, general consequences of using independent contractors, specific impact of independent contractors on participation in EBP initiatives, and suggestions for alternatives. CONCLUSIONS A growing number of community mental health clinics rely on independent contractors. There may be consequences of this shift that deserve exploration.

Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems.

This special issue of Administration and Policy in Mental Health explores the complexities of the outer system context in implementation science research. In this commentary, we highlight areas of asynchrony between implementation science research and policy realities of public systems. Timing is a critical factor for many aspects of system-level implementation including when and how evidence-based practice initiatives are launched, short and inconsistent timeframes for funding and support, need for early indicators of success and demonstrating return on investment. Greater consideration for the timing that drives change in public systems will strengthen efforts to implement and sustain EBPs in community settings.

The relationship between consumer, clinician, and organizational characteristics and use of evidence-based and non-evidence-based therapy strategies in a public mental health system

We investigated the relationship between consumer, clinician, and organizational factors and clinician use of therapy strategies within a system-wide effort to increase the use of cognitive-behavioral therapy. Data from 247 clinicians in 28 child-serving organizations were collected. Clinicians participating in evidence-based practice training initiatives were more likely to report using cognitive-behavioral therapy when they endorsed more clinical experience, being salaried clinicians, and more openness to evidence-based practice. Clinicians participating in evidence-based practice initiatives were more likely to use psychodynamic techniques when they had older clients, less knowledge about evidence-based practice, more divergent attitudes toward EBP, higher financial strain, and worked in larger organizations. In clinicians not participating in evidence-based training initiatives; depersonalization was associated with higher use of cognitive-behavioral; whereas clinicians with less knowledge of evidence-based practices were more likely to use psychodynamic techniques. This study suggests that clinician characteristics are important when implementing evidence-based practices; and that consumer, clinician, and organizational characteristics are important when de-implementing non evidence-based practices. This work posits potential characteristics at multiple levels to target with implementation and deimplementation strategies.

Therapist and Organizational Factors Associated with Participation in Evidence-Based Practice Initiatives in a Large Urban Publicly-Funded Mental Health System

The goal of this study was to identify therapist and organizational characteristics associated with participation in evidence-based practice (EBP) training initiatives sponsored by a large publicly funded mental health system. Self-report data from therapists (N = 247) nested within 28 mental health clinics was collected in 2015. Results from regression analyses indicated that length of time employed at an organization was associated with individual therapist participation in an EBP initiative. Organizational and implementation climate were associated with organizational participation in an EBP initiative. Organizations characterized by higher levels of stress were more likely to participate in EBP initiatives and organizations characterized by higher engagement and educational support for EBPs were less likely to participate. Implications include the need for systems to consider organizational characteristics when sponsoring organizations in EBP initiatives.

The Price per Prospective Consumer of Providing Therapist Training and Consultation in Seven Evidence-Based Treatments within a Large Public Behavioral Health System: An Example Cost-Analysis Metric

Objective Public-sector behavioral health systems seeking to implement evidence-based treatments (EBTs) may face challenges selecting EBTs given their limited resources. This study describes and illustrates one method to calculate cost related to training and consultation to assist system-level decisions about which EBTs to select. Methods Training, consultation, and indirect labor costs were calculated for seven commonly implemented EBTs. Using extant literature, we then estimated the diagnoses and populations for which each EBT was indicated. Diagnostic and demographic information from Medicaid claims data were obtained from a large behavioral health payer organization and used to estimate the number of covered people with whom the EBT could be used and to calculate implementation-associated costs per consumer. Results Findings suggest substantial cost to therapists and service systems related to EBT training and consultation. Training and consultation costs varied by EBT, from Dialectical Behavior Therapy at