Danielle L. Fettes

Evidence-based practice implementation and staff emotional exhaustion in children's services.

Understanding the implementation of evidence-based practice (EBP) in community service settings is critical for the successful translation of research to practice. However, we have limited research evidence about the impact of EBP implementation on the mental health and social service workforce. In a previous study we demonstrated reduced staff turnover where an EBP was implemented with fidelity monitoring in the form of supportive ongoing supervision and consultation. Other research has shown that staff burnout and emotional exhaustion in particular is associated with poor quality of care and increased staff turnover intentions and turnover. Current research, however, has focused less on the effects that EBP implementation may have on staff emotional exhaustion. The present study investigates the association of EBP implementation and fidelity monitoring with staff emotional exhaustion in a statewide EBP implementation study. The 21 case-management teams in this study were randomized in a 2 (EBP vs. services as usual [SAU]) by 2 (monitoring vs. no monitoring) design. The EBP in this study was SafeCare, a home-based intervention that aims to reduce child neglect in at-risk families. SafeCare was developed from a behavior analysis approach and is based in cognitive behavioral principles. In keeping with our previous research, we hypothesized that providers implementing SafeCare with monitoring would have the lowest levels of emotional exhaustion and those receiving additional monitoring not in the context of EBP implementation would have higher emotional exhaustion relative to the other groups. Results supported our hypotheses in that we found lower emotional exhaustion for staff implementing the EBP but higher emotional exhaustion for staff receiving only fidelity monitoring and providing SAU. Together, these results suggest a potential staff and organizational benefit to EBP implementation and we discuss implications of the findings relative to EBPs and to fidelity monitoring.

Mixed Methods for Implementation Research: Application to Evidence-Based Practice Implementation and Staff Turnover in Community-Based Organizations Providing Child Welfare Services

Many public sector service systems and provider organizations are in some phase of learning about or implementing evidence-based interventions. Child welfare service systems represent a context where implementation spans system, management, and organizational concerns. Research utilizing mixed methods that combine qualitative and quantitative design, data collection, and analytic approaches are particularly well suited to understanding both the process and outcomes of dissemination and implementation efforts in child welfare systems. This article describes the process of using mixed methods in implementation research and provides an applied example of an examination of factors impacting staff retention during an evidence-based intervention implementation in a statewide child welfare system. The authors integrate qualitative data with previously published quantitative analyses of job autonomy and staff turnover during this statewide implementation project in order to illustrate the utility of mixed method approaches in providing a more comprehensive understanding of opportunities and challenges in implementation research.

Collaboration, Negotiation, and Coalescence for Interagency-Collaborative Teams to Scale-Up Evidence-Based Practice

Implementation and scale-up of evidence-based practices (EBPs) is often portrayed as involving multiple stakeholders collaborating harmoniously in the service of a shared vision. In practice, however, collaboration is a more complex process that may involve shared and competing interests and agendas, and negotiation. The present study examined the scale-up of an EBP across an entire service system using the Interagency Collaborative Team approach. Participants were key stakeholders in a large-scale county-wide implementation of an EBP to reduce child neglect, SafeCare®. Semistructured interviews and/or focus groups were conducted with 54 individuals representing diverse constituents in the service system, followed by an iterative approach to coding and analysis of transcripts. The study was conceptualized using the Exploration, Preparation, Implementation, and Sustainment framework. Although community stakeholders eventually coalesced around implementation of SafeCare, several challenges affected the implementation process. These challenges included differing organizational cultures, strategies, and approaches to collaboration; competing priorities across levels of leadership; power struggles; and role ambiguity. Each of the factors identified influenced how stakeholders approached the EBP implementation process. System-wide scale-up of EBPs involves multiple stakeholders operating in a nexus of differing agendas, priorities, leadership styles, and negotiation strategies. The term collaboration may oversimplify the multifaceted nature of the scale-up process. Implementation efforts should openly acknowledge and consider this nexus when individual stakeholders and organizations enter into EBP implementation through collaborative processes.

Prevalence of Maltreatment Among Youths in Public Sectors of Care

Few studies have investigated the prevalence of maltreatment among youths in public sectors of care despite the critical public health concern and the burden of suffering on such youths. The current study examined the prevalence of multiple types of maltreatment across five public sectors of care. Youths aged 11–18 (n = 1,135) enrolled in one of five public sectors of care reported on their maltreatment history using the Childhood Trauma Questionnaire. Across all sectors, 78% of youth reported experiencing at least moderate levels of maltreatment with the majority (58%) reporting multiple types of maltreatment. The prevalence of maltreatment was highest for youths involved in the alcohol/drug (86%) and child welfare (85%) sectors, and lowest in the serious emotional disturbance sector (72%). Logistic regressions were conducted to examine differences in the likelihood of multiple types of maltreatment by sector affiliation, controlling for the effects of gender, race/ethnicity, and age. The results indicate that rates of maltreatment across sectors do not differ greatly from those in child welfare. The high incidence of maltreatment across all sectors, not solely child welfare, indicates that all youth in public sectors of care should be screened for a history of maltreatment when they enter into care.

A Concept Mapping Approach to Guide and Understand Dissemination and Implementation

Many efforts to implement evidence-based programs do not reach their full potential or fail due to the variety of challenges inherent in dissemination and implementation. This article describes the use of concept mapping—a mixed method strategy—to study implementation of behavioral health innovations and evidence‐based practice (EBP). The application of concept mapping to implementation research represents a practical and concise way to identify and quantify factors affecting implementation, develop conceptual models of implementation, target areas to address as part of implementation readiness and active implementation, and foster communication among stakeholders. Concept mapping is described and a case example is provided to illustrate its use in an implementation study. Implications for the use of concept mapping methods in both research and applied settings towards the dissemination and implementation of behavioral health services are discussed.

Cultural adaptation of an evidence-based home visitation programme: Latino clients’ experiences of service delivery during implementation

Purpose – The purpose of this paper is to examine the experiences of Latino clients following a naturalistic cultural adaptation made to SafeCare, an evidence-based home visiting intervention designed to address specific linguistic and cultural issues affecting the Latino community during implementation in San Diego County, California. Design/methodology/approach – Hierarchical linear models examined whether Latino clients experienced differences in perceptions of SafeCare delivery, working relationship with the home visitor and satisfaction with services when compared with non-Latino clients and whether language of service delivery and provider-client ethnic match were related to Latino clients’ experiences of the intervention. Findings – Overall, across several different dimensions, there was no decrement in experience with SafeCare for Latino clients compared to non-Latino ones, implying that adaptations made locally adequately engaged Latino and Spanish-speaking clients in services without compromising perceived adherence to the programme model. Research limitations/implications – Because this was a non-experimental study, conclusions could not be drawn as to whether the locally adapted SafeCare would fare better in Latino client ratings than SafeCare unadapted. However, the findings are important because they contradict concerns that EBPs may not be relevant to diverse client groups, and support the idea that when adaptations are made, it is possible to maintain adherence at the same level of adherence as when the programme is delivered in its non-adapted form. Originality/value – The study explicitly documents and generates knowledge around an organic adaptation made in a community to an evidence-based intervention for a client group about whom there has been documented concern regarding the relevance of and engagement in services.

Smoking Behavior of US Youths: A Comparison Between Child Welfare System and Community Populations

OBJECTIVES We compared rates of smoking for 2 groups of youths aged 12 to 14 years: those involved in the child welfare system (CW) and their counterparts in the community population. We then investigated factors associated with smoking for each group. METHODS We drew data from 2 national-level US sources: the National Survey of Child and Adolescent Well-Being and the National Longitudinal Study of Adolescent Health. We estimated logistic regression models for 3 binary outcome measures of smoking behavior: lifetime, current, and regular smoking. RESULTS CW-involved youths had significantly higher rates of lifetime smoking (43% vs 32%) and current smoking (23% vs 18%) than did youths in the community population. For CW-involved youths, delinquency and smoking were strongly linked. Among youths in the community population, multiple factors, including youth demographics and emotional and behavioral health, affected smoking behavior. CONCLUSIONS Smoking prevalence was notably higher among CW-involved youths than among the community population. In light of the persistent public health impact of smoking, more attention should be focused on identification of risk factors for prevention and early intervention efforts among the CW-involved population.

Research-Supported Intervention and Discretion Among Frontline Workers Implementing Home Visitation Services:

Objective: We examine how frontline workers and supervisors delivering a research-supported intervention (RSI) to reduce child neglect negotiated system-related challenges, the pragmatics of RSI implementation, and their professional identities and relationships with clients. Methods: We conducted semi-structured interviews, small group discussions, and focus groups with frontline workers and supervisors in one large county over two time periods. We used iterative coding to analyze qualitative data. Results: Frontline workers navigated several aspects of RSI implementation and sustainment: (1) contract requirements and information dissemination, (2) fidelity, (3) competing demands and crises, (4) structure versus creativity, and (5) relationships with clients. Conclusions: Workers dynamically negotiated multiple system- and provider-level (or outer- and inner-contextual) demands influencing RSI provision for clients with complex service needs. Results affirm the need to attend to the unintended consequences of implementing new contract, reimbursement, and other system or organizational processes and to address the “committed work” supporting RSI delivery.