Takuya Minami

Establishing Specificity in Psychotherapy: A Meta-Analysis of Structural Equivalence of Placebo Controls

Placebo treatments in psychotherapy cannot adequately control for all common factors, which thereby attenuates their effects vis-a-vis active treatments. In this study, the authors used meta-analytic procedures to test one possible factor contributing to the attenuation of effects: structural inequalities between placebo and active treatments. Structural aspects of the placebo included number and duration of sessions, training of therapist, format of therapy, and restriction of topics. Results indicate that comparisons between active treatments and structurally inequivalent placebos produced larger effects than comparisons between active treatments and structurally equivalent placebos: moreover, the latter comparison produced negligible effects, indicating that active treatments were not demonstrably superior to well-designed placebos.

Benchmarking the Effectiveness of Psychotherapy Treatment for Adult Depression in a Managed Care Environment : A Preliminary Study

This preliminary study evaluated the effectiveness of psychotherapy treatment for adult clinical depression provided in a natural setting by benchmarking the clinical outcomes in a managed care environment against effect size estimates observed in published clinical trials. Overall results suggest that effect size estimates of effectiveness in a managed care context were comparable to effect size estimates of efficacy observed in clinical trials. Relative to the 1-tailed 95th-percentile critical effect size estimates, effectiveness of treatment provided in this setting was observed to be between 80% (patients with comorbidity and without antidepressants) and 112% (patients without comorbidity concurrently on antidepressants) as compared to the benchmarks. Because the nature of the treatments delivered in the managed care environment were unknown, it was not possible to make conclusions about treatments. However, while replications are warranted, concerns that psychotherapy delivered in a naturalistic setting is inferior to treatments delivered in clinical trials appear unjustified.

Benchmarks for Psychotherapy Efficacy in Adult Major Depression

This study estimates pretreatment-posttreatment effect size benchmarks for the treatment of major depression in adults that may be useful in evaluating psychotherapy effectiveness in clinical practice. Treatment efficacy benchmarks for major depression were derived for 3 different types of outcome measures: the Hamilton Rating Scale for Depression (M. A. Hamilton, 1960, 1967), the Beck Depression Inventory (A. T. Beck, 1978; A. T. Beck & R. A. Steer, 1987), and an aggregation of low reactivity-low specificity measures. These benchmarks were further refined for 3 conditions: treatment completers, intent-to-treat samples, and natural history (wait-list) conditions. The study confirmed significant effects of outcome measure reactivity and specificity on the pretreatment-posttreatment effect sizes. The authors provide practical guidance in using these benchmarks to assess treatment effectiveness in clinical settings.

Evidence-based treatments for depression and anxiety versus treatment-as-usual: A meta-analysis of direct comparisons☆

OBJECTIVE The aim of this study was to examine the relative efficacy of evidence-based treatments (EBTs) versus treatment-as-usual (TAU) in routine care for anxiety and depression in adults. METHOD A computerized search of studies that directly compared an EBT with a TAU was conducted. Meta-analytic methods were used to estimate effectiveness of EBTs relative to TAU and to model how various confounding variables impacted the results of this comparative research. RESULTS A total of 14 studies were included in the final meta-analysis. There was significant heterogeneity in the TAU conditions, which ranged from unknown and/or minimal mental health treatment to psychotherapeutic interventions provided by trained professionals. Although the effect for EBT vs. TAU was significantly greater than zero, the effect for EBT vs. TAUs that were psychotherapeutic interventions was not statistically different from zero. CONCLUSIONS Heterogeneity of TAU conditions in this meta-analysis highlight the importance of clarifying the research questions being asked when investigating and drawing conclusions from EBT-TAU comparisons. Researchers need to clarify if they are comparing an EBT to psychotherapeutic services in routine care or to minimal mental health services. Extant research on EBT versus TAU reveals that there is insufficient evidence to recommend the transportation of EBTs for anxiety and depression to routine care, particularly when the routine care involves psychotherapeutic services.

Uniformity of evidence-based treatments in practice? Therapist effects in the delivery of cognitive processing therapy for PTSD.

OBJECTIVE Various factors contribute to the effective implementation of evidence-based treatments (EBTs). In this study, cognitive processing therapy (CPT) was administered in a Veterans Affairs (VA) posttraumatic stress disorder (PTSD) specialty clinic in which training and supervision were provided following VA implementation guidelines. The aim was to (a) estimate the proportion of variability in outcome attributable to therapists and (b) identify characteristics of those therapists who produced better outcomes. METHOD We used an archival database of veterans (n = 192) who completed 12 sessions of CPT by therapists (n = 25) who were trained by 2 nationally recognized trainers, 1 of whom also provided weekly group supervision. Multilevel modeling was used to estimate therapist effects, with therapists treated as a random factor. The supervisor was asked to retrospectively rate each therapist in terms of perceived effectiveness based on supervision interactions. Using single case study design, the supervisor was interviewed to determine what criteria she used to rate the therapists and emerging themes were coded. RESULTS When initial level of severity on the PTSD Checklist (PCL; McDonald & Calhoun, 2010; Weathers, Litz, Herman, Huska, & Keane, 1993) was taken into account, approximately 12% of the variability in the PCL at the end of treatment was due to therapists. The trainer, blind to the results, identified the following characteristics and actions of effective therapists: effectively addressing patient avoidance, language used in supervision, flexible interpersonal style, and ability to develop a strong therapeutic alliance. CONCLUSIONS This study adds to the growing body of literature documenting the importance of the individual therapist as an important factor in the change process.

Benchmarking Outcomes in a Public Behavioral Health Setting: Feedback as a Quality Improvement Strategy

OBJECTIVE The purpose of this study was to evaluate the effectiveness of a large public behavioral health (PBH) agency serving only clients at or below the federal poverty level that had implemented continuous outcome feedback as a quality improvement strategy. METHOD The authors investigated the post treatment outcomes of 5,168 individuals seeking treatment for a broad range of diagnoses who completed at least 2 psychotherapy sessions. The Outcome Rating Scale (ORS; Duncan, 2011; Miller & Duncan, 2004) was used to measure outcomes. Clients had a mean age of 36.7 years and were predominantly female (60.7%) and White (67.8%), with 17.7% being Hispanic, 9.3% being African American, and 2.8% being Native American. Forty-six percent were diagnosed with depression, mood, and anxiety disorders; 18.8% were diagnosed with substance abuse disorders; and 14.4% were diagnosed with bipolar disorder and schizophrenia. A subset of clients with a primary diagnosis of a depressive disorder was compared to treatment efficacy benchmarks derived from clinical trials of major depression. Given that the PBH agency had also implemented an outcome management system, the total sample was also compared to benchmarks derived from clinical trials of continuous outcome feedback. RESULTS Treatment effect sizes of psychotherapy delivered at the PBH agency were comparable to effect size estimates of clinical trials of depression and feedback. Observed effect sizes were smaller, however, when compared to feedback benchmarks that used the ORS. CONCLUSIONS Services to the poor and disabled can be effective, and continuous outcome feedback may be a viable means both to improve outcomes and to narrow the gap between research and practice.

Young parenthood program: supporting positive paternal engagement through coparenting counseling.

OBJECTIVES Because of their youth, adolescent parents often lack the interpersonal skills necessary to manage the relationship challenges involved in parenting, leaving them and their children vulnerable to the health risks associated with relational stress and conflict. The primary goal of this study was to test the efficacy of the Young Parenthood Program (YPP), a 10-week counseling program administered during pregnancy and designed to facilitate interpersonal skill development and positive parenting among adolescent parents. METHODS Participants included 105 pregnant adolescents and their partners randomly assigned to YPP or treatment as usual. Assessments measured coparenting skills and parental functioning during the second trimester, 12 weeks after birth, and 18 months after birth. RESULTS Results indicated that fathers completing YPP demonstrated more positive parenting than did fathers in the control group. Moreover, the positive outcomes in paternal functioning were mediated through changes in the mothers interpersonal skill development. CONCLUSIONS Results supported the efficacy of this couples-focused, coparenting support program, particularly for facilitating positive paternal engagement. These findings underscored the relevance of including fathers in the delivery of maternal-child public health services.

Cultural Accommodation of Group Substance Abuse Treatment for Latino Adolescents: Results of an RCT

Comparative studies examining the difference between empirically supported substance abuse treatments versus their culturally accommodated counterparts with participants from a single ethnic minority group are frequently called for in the literature but infrequently conducted in practice. This randomized clinical trial was conducted to compare the efficacy of an empirically supported standard version of a group-based cognitive-behavioral treatment (S-CBT) to a culturally accommodated version (A-CBT) with a sample of Latino adolescents primarily recruited from the juvenile justice system. Development of the culturally accommodated treatment and testing was guided by the Cultural Accommodation Model for Substance Abuse Treatment (CAM-SAT). Seventy Latino adolescents (mean age = 15.2; 90% male) were randomly assigned to 1 of 2 group-based treatment conditions (S-CBT = 36; A-CBT = 34) with assessments conducted at pretreatment, posttreatment, and 3-month follow-up. Longitudinal Poisson mixed models for count data were used to conduct the major analyses. The primary outcome variable in the analytic models was the number of days any substance was used (including alcohol, except tobacco) in the past 90 days. In addition, the variables ethnic identity, familism, and acculturation were included as cultural moderators in the analysis. Although both conditions produced significant decreases in substance use, the results did not support a time by treatment condition interaction; however, outcomes were moderated by ethnic identity and familism. The findings are discussed with implications for research and practice within the context of providing culturally relevant treatment for Latino adolescents with substance use disorders.

A collaborative outcome resource network (ACORN): Tools for increasing the value of psychotherapy.

The authors describe a collaborative outcomes resource network (ACORN) and the suite of measurement and decision support tools (ACORN Toolkit) that have emerged from this collaboration for the purpose of providing clinical feedback to therapists. The ACORN Toolkit is most accurately described as a comprehensive clinical information system designed to increase the value of mental health services across large systems of care. It was built to integrate large datasets from multiple sources including outcome data, client demographics and diagnostic data, therapist credentialing information, pharmacy data, and service claims data. For the limited purposes of this article, the authors focus on the ACORN Toolkit for measuring and how it has contributed to improving outcomes in psychotherapy. Implications to current practice and future training are provided.

A five-year evaluation of the Human Givens therapy using a practice research network

Purpose – To replicate the Luton pilot study (Andrews et al., 2011), both by investigating treatment changes using the Human Givens (HG) approach via a practice research network (PRN) and by assessing the viability of replacing the 34-item Clinical Outcome in Routine Evaluation Outcome Measure (CORE-OM) with the ten-item version (CORE-10). Design/methodology/approach – Clients were included if they were offered the HG approach to manage psychological distress and attended at least one measured treatment session following their initial assessment. Pre-post treatment effect size (Cohens d) was benchmarked against data from Clark et al. (2009). Potential differences in treatment effects based on type of termination (planned vs unplanned) and medication use were examined. Findings – High correlation between the CORE-10 and CORE-OM and near-identical calculated effect sizes support the utilisation of CORE-10 as a routine outcome measure. Pre-post treatment effect size suggests that clients treated using the H...