Sonja K. Schoenwald

Family preservation using multisystemic treatment: Long-term follow-up to a clinical trial with serious juvenile offenders

In a randomized clinical trial, multisystemic family preservation was shown to significantly reduce rates of criminal activity and incarceration in a sample of 84 serious juvenile offenders and their multi-need families. In the current study, archival records were searched for re-arrest an average of 2.4 years post-referral. Survival analysis showed that youths who received multisystemic family preservation were less likely to be re-arrested than were youths who had received usual services. Such results represent the first controlled demonstration that family preservation, when delivered via a clearly specified treatment model, has lasting effects with serious juvenile offenders. Implications for family preservation and juvenile justice research are discussed.

Toward the Effective and Efficient Measurement of Implementation Fidelity

Implementation science in mental health is informed by other academic disciplines and industries. Conceptual and methodological territory charted in psychotherapy research is pertinent to two elements of the conceptual model of implementation posited by Aarons and colleagues (2010)—implementation fidelity and innovation feedback systems. Key characteristics of scientifically validated fidelity instruments, and of the feasibility of their use in routine care, are presented. The challenges of ensuring fidelity measurement methods are both effective (scientifically validated) and efficient (feasible and useful in routine care) are identified as are examples of implementation research attempting to balance these attributes of fidelity measurement.

Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy.

OBJECTIVE A randomized trial assessed the effectiveness of a 2-level strategy for implementing evidence-based mental health treatments for delinquent youth. METHOD A 2 x 2 design encompassing 14 rural Appalachian counties included 2 factors: (a) the random assignment of delinquent youth within each county to a multisystemic therapy (MST) program or usual services and (b) the random assignment of counties to the ARC (for availability, responsiveness, and continuity) organizational intervention for implementing effective community-based mental health services. The design created 4 treatment conditions (MST plus ARC, MST only, ARC only, control). Outcome measures for 615 youth who were 69% male, 91% Caucasian, and aged 9-17 years included the Child Behavior Checklist and out-of-home placements. RESULTS A multilevel, mixed-effects, regression analysis of 6-month treatment outcomes found that youth total problem behavior in the MST plus ARC condition was at a nonclinical level and significantly lower than in other conditions. Total problem behavior was equivalent and at nonclinical levels in all conditions by the 18-month follow-up, but youth in the MST plus ARC condition entered out-of-home placements at a significantly lower rate (16%) than youth in the control condition (34%). CONCLUSIONS Two-level strategies that combine an organizational intervention such as ARC and an evidence-based treatment such as MST are promising approaches to implementing effective community-based mental health services. More research is needed to understand how such strategies can be used effectively in a variety of organizational contexts and with other types of evidence-based treatments.

Transporting Efficacious Treatments to Field Settings: The Link Between Supervisory Practices and Therapist Fidelity in MST Programs

Validated a measure of clinical supervision practices, further validated a measure of therapist adherence, and examined the association between supervisory practices and therapist adherence to an evidence-based treatment model (i.e., multisystemic therapy [MST]) in real-world clinical settings. Evidence of linkages between supervisor adherence to the MST supervisory protocol, as assessed through therapist reports, and therapist adherence to MST principles, as assessed through caregiver reports, was obtained from 285 families of youths presenting serious clinical problems, and 74 therapists and 12 supervisors of 16 teams in 9 organizations providing MST across 3 states. The findings provide a valuable step in examining the determinants of therapist fidelity to complex treatments in real-world clinical settings.

Toward Effective Quality Assurance in Evidence-Based Practice: Links Between Expert Consultation, Therapist Fidelity, and Child Outcomes

This study validated a measure of expert clinical consultation and examined the association between consultation, therapist adherence, and youth outcomes in community-based settings. Consultant adherence to the multisystemic therapy (MST) consultation protocol was assessed through therapist reports, and therapist adherence to MST principles was assessed through caregiver reports in 2 samples of families (N1 = 178, N2 = 274) and therapists (N1 = 87, N2 = 162). Caregiver reports of youth behavior and functioning were obtained in the second sample pre- and posttreatment. Random effects regression models demonstrated associations between consultant behavior, therapist adherence, and posttreatment youth behavior problems and functioning. Instrumental aspects of consultation supported therapist adherence and improved youth outcomes; supportive aspects of consultation were negatively associated with adherence and outcomes. These findings suggest the availability to clinicians of expert consultation can impact clinician fidelity to a treatment model and child outcomes.

Transportability of Multisystemic Therapy: Evidence for Multilevel Influences

This study examines factors associated with the implementation and short-term outcomes in dissemination sites of Multisystemic Therapy (MST), an intensive, short-term, family- and community-based treatment for serious antisocial behavior in youth. Participants were 666 children and families served by 217 therapists in 39 sites. Pre- (T1) to immediate posttreatment (T2) differences in child problems and functioning were similar in magnitude to those found in randomized trials of MST. Results of random effects regression supported direct effects of therapist adherence, organizational climate, and structure at baseline on immediate posttreatment child outcomes. However, organizational factors were unrelated to adherence; thus, a hypothesized mediation model in which organizational climate and structure affect outcomes through therapist adherence to MST was not supported. Furthermore, the direction of associations between some organizational climate variables and outcomes countered expectations. Post hoc moderation analyses clarify these findings, with organizational effects differing by level of therapist adherence during treatment. Implications for the transfer of evidence-based psychosocial treatments for youth to usual care practice settings are discussed.

Multisystemic therapy treatment of substance abusing or dependent adolescent offenders: Costs of reducing incarceration, inpatient, and residential placement

The development of more effective and less costly family- and community-based services to serve as alternatives to out-of-home placements of children is an important priority in the reform of mental health services for children and adolescents. Within the context of a randomized trial with 118 substance abusing or dependent juvenile offenders, we examined the incremental costs of multisystemic therapy (MST) and related these costs to observed reductions in days of incarceration, hospitalization, and residential treatment at approximately 1 year postreferral. Results showed that the incremental costs of MST were nearly offset by the savings incurred as a result of reductions in days of out-of-home placement during the year. The need to validate effective treatments for youth with serious clinical problems and to link the costs of treatment

Clinical Supervision in Treatment Transport: Effects on Adherence and Outcomes

This nonexperimental study used mixed-effects regression models to examine relations among supervisor adherence to a clinical supervision protocol, therapist adherence, and changes in the behavior and functioning of youths with serious antisocial behavior treated with an empirically supported treatment (i.e., multisystemic therapy [MST]) 1 year posttreatment. Participants were 1,979 youths and families treated by 429 clinicians across 45 provider organizations in North America. Four dimensions of clinical supervision were examined. Mixed-effects regression model results showed that one dimension, supervisor focus on adherence to treatment principles, predicted greater therapist adherence. Two supervision dimensions, Adherence to the Structure and Process of Supervision and focus on Clinician Development, predicted changes in youth behavior. Conditions required to test hypothesized mediation by therapist adherence of supervisor adherence effects on youth outcomes were not met. However, direct effects of supervisor and therapist adherence were observed in models including both of these variables.

Comprehensive community-based interventions for youth with severe emotional disorders: Multisystemic therapy and the wraparound process

Two comprehensive community-based interventions for youth with severe emotional disorders are contrasted and compared. The interventions are multisystemic therapy (MST)—a brief but intensive, clinician-provided, and home-based treatment; and wraparound—a long-term approach to planning and coordinating the provision of both formal and informal services in the community. Both approaches are spreading rapidly across the country. As this occurs, it is important for families, clinicians, and policymakers to have sufficient information to understand the requirements and the research base for each. This paper provides a description of both MST and wraparound across multiple dimensions (i.e., origin, theory, target population, principles, role of family, cultural competence, staffing, training, quality monitoring, costs, and the evidence base). The respective similarities and differences are discussed and options for utilizing both for selected youth and families who require intensive and long-term care are explored briefly.

Statewide Adoption and Initial Implementation of Contingency Management for Substance Abusing Adolescents

Four hundred thirty-two public sector therapists attended a workshop in contingency management (CM) and were interviewed monthly for the following 6 months to assess their adoption and initial implementation of CM to treat substance-abusing adolescent clients. Results showed that 58% (n = 131) of the practitioners with at least one substance-abusing adolescent client (n = 225) adopted CM. Rates of adoption varied with therapist service sector (mental health vs. substance abuse), educational background, professional experience, and attitudes toward treatment manuals and evidence-based practices. Competing clinical priorities and client resistance were most often reported as barriers to adopting CM, whereas unfavorable attitudes toward and difficulty in implementing CM were rarely cited as barriers. The fidelity of initial CM implementation among adopters was predicted by organizational characteristics as well as by several demographic, professional experience, attitudinal, and service sector characteristics. Overall, the findings support the amenability of public sector practitioners to adopt evidence-based practices and suggest that the predictors of adoption and initial implementation are complex and multifaceted.