Brad J. Nakamura

Concurrent Validity of the Child Behavior Checklist DSM-Oriented Scales: Correspondence with DSM Diagnoses and Comparison to Syndrome Scales

This study used receiver operating characteristic (ROC) methodology and discriminative analyses to examine the correspondence of the Child Behavior Checklist (CBCL) rationally-derived DSM-oriented scales and empirically-derived syndrome scales with clinical diagnoses in a clinic-referred sample of children and adolescents (N = 476). Although results demonstrated that the CBCL Anxiety, Affective, Attention Deficit/Hyperactivity, Oppositional and Conduct Problems DSM-oriented scales corresponded significantly with related clinical diagnoses derived from parent-based structured interviews, these DSM-oriented scales did not evidence significantly greater correspondence with clinical diagnoses than the syndrome scales in all cases but one. The DSM-oriented Anxiety Problems scale was the only scale that evidenced significantly greater correspondence with diagnoses above its syndrome scale counterpart —the Anxious/Depressed scale. The recently developed and rationally-derived DSM-oriented scales thus generally do not add incremental clinical utility above that already afforded by the syndrome scales with respect to corresponding with diagnoses. Implications of these findings are discussed.

Long-term outcomes for the Child STEPs randomized effectiveness trial: a comparison of modular and standard treatment designs with usual care.

OBJECTIVE This article reports outcomes from the Child STEPs randomized effectiveness trial conducted over a 2-year period to gauge the longer term impact of protocol design on the effectiveness of evidence-based treatment procedures. METHOD An ethnoracially diverse sample of 174 youths ages 7- 13 (N = 121 boys) whose primary clinical concerns involved diagnoses or clinical elevations related to anxiety, depression, or disruptive behavior were treated by community therapists randomly assigned to 1 of 3 conditions: (a) standard, which involved the use of 1 or more of 3 manualized evidence-based treatments, (b) modular, which involved a single modular protocol (Modular Approach to Treatment of Children With Anxiety, Depression, or Conduct Problems; MATCH) having clinical procedures similar to the standard condition but flexibly selected and sequenced using a guiding clinical algorithm, and (c) usual care. RESULTS As measured with combined Child Behavior Checklist and Youth Self-Report Total Problems, Internalizing, and Externalizing scales, the rate of improvement for youths in the modular condition was significantly better than for those in usual care. On a measure of functional impairment (Brief Impairment Scale), no significant differences were found among the 3 conditions. Analysis of service utilization also showed no significant differences among conditions, with almost half of youths receiving some additional services in the 1st year after beginning treatment, and roughly one third of youths in the 2nd year. CONCLUSIONS Overall, these results extend prior findings, supporting incremental benefits of MATCH over usual care over a 2-year period.

Symptoms of schizotypy precede cannabis use.

The current investigation uses a large non-clinical sample of undergraduate college students (N=189) to investigate schizotypal traits among cannabis and non-cannabis users, as well as the temporal order of the onset of these traits and cannabis use. Findings suggest that regular cannabis users are significantly more prone to cognitive and perceptual distortions as well as disorganization, but not interpersonal deficits, than non-regular users and those who have never used. Additionally, the onset of schizotypal symptoms generally precedes the onset of cannabis use. The findings do not support a causal link between cannabis use and schizotypal traits.

A Bifactor Model of Negative Affectivity: Fear and Distress Components among Younger and Older Youth.

The Positive and Negative Affect Schedule for Children (PANAS-C) is a 27-item youth-report measure of positive affectivity and negative affectivity. Using 2 large school-age youth samples (clinic-referred sample: N = 662; school-based sample: N = 911), in the present study, we thoroughly examined the structure of the PANAS-C NA and PA scales and fit a bifactor model to the PANAS-C NA items. Our exploratory factor analytic results demonstrated that negative affectivity is comprised of 2 main components-NA: Fear and NA: Distress-specifically among older youth. A bifactor model also evidenced the best model fit relative to a unidimensional and second-order factor structure of the PANAS-C NA items. The NA: Fear group factor evidenced significant correspondence with external criterion measures of anxiety. However, the original PANAS-C NA scale evidenced equal (and in some cases greater) correspondence with criterion measures of anxiety. We thus recommend continued usage and interpretation of the full PANAS-C NA scale despite the identification of the fear and distress group factors underlying general negative affectivity. The identification of these fear and distress group factors nonetheless suggest that negative affectivity may be comprised largely of a fear and distress component among older youth. The implications of these findings are discussed in relation to better understanding the structure of psychopathology across childhood development and informing the development of future treatments of negative emotions.

Parental Assessment of Childhood Social Phobia: Psychometric Properties of the Social Phobia and Anxiety Inventory for Children-Parent Report

Validity and parent–child agreement of the Social Phobia and Anxiety Inventory for Children–Parent Report (SPAI–C–P) were examined in a racially diverse sample of 158 students in Grades 5 through 8 (87 girls; ages 10 to 14; M = 11.53) and their caregivers. Children completed the Social Phobia and Anxiety Inventory for Children (SPAI–C), and caregivers completed the SPAI–C–P and the Child Behavior Checklist (CBCL). The SPAI–C–P demonstrated good internal consistency and was significantly correlated with child self-reported social anxiety. Confirmatory factor analysis supported a 3-factor model over a 5-factor model, and concurrent validity was evidenced. Implications and directions for future research are discussed.

Balancing effectiveness with responsiveness: Therapist satisfaction across different treatment designs in the Child STEPs randomized effectiveness trial.

OBJECTIVE To investigate the association between protocol design and therapist satisfaction in the Child STEPs Randomized Effectiveness Trial (Weisz et al., 2012). METHOD Therapist report was obtained at the close of 145 cases seen by 77 therapists, each of whom was randomized to a Standard evidence-based treatment (EBT), modular EBT, or usual care (UC) condition. RESULTS Analysis of satisfaction items revealed 2 correlated factors representing perceived effectiveness and perceived responsiveness of the treatments. Therapist total satisfaction scores were significantly higher for cases in the modular condition than for those in the standard EBT or UC conditions. With regard to specific dimensions, the modular and UC cases were rated significantly higher than standard EBT cases on the Responsiveness scale, whereas modular and standard EBT cases were rated significantly higher than UC on the Effectiveness scale. Finally, increases in Effectiveness scores from first to second case were significantly larger for Modular cases than for cases in both other study conditions, and increases from first to second case in Total Satisfaction scores were significantly larger for modular cases than for UC cases. CONCLUSIONS Therapist satisfaction with a treatment approach has independent dimensions, which can vary as a function of the protocol design. By virtue of being perceived as more effective than UC and more responsive than standard EBTs, the modular protocol design was also viewed as more overall satisfying than both, and secondary analysis suggested that these results were not due to mere first impressions of the protocols.

From distal to proximal: routine educational data monitoring in school-based mental health

Research and practice in school-based mental health (SBMH) typically include educational variables only as distal outcomes, resulting from improvements in mental health symptoms rather than directly from mental health intervention. Although sometimes appropriate, this approach also has the potential to inhibit the integration of mental health and schools. This paper applies an existing model of data-driven decision-making (Daleiden, E., & Chorpita, B.F. (2005). From data to wisdom: Quality improvement strategies supporting large-scale implementation of evidence based services. Child and Adolescent Psychiatric Clinics of North America, 14, 329–349) to detail how SBMH can better integrate routine monitoring of school and academic outcomes into four evidence bases: general services research evidence, case histories, local aggregate and causal mechanisms. The importance of developing new consultation protocols specific to data-driven decision-making in SBMH as well as supportive infrastructure (e.g. measurement feedback systems) to support the collection and use of educational data is also described.

Predictors of use of evidence-based practices for children and adolescents in usual care.

Practice data from 74 therapists providing public mental health services to 519 youth ages 5–19 were examined. Multilevel modeling suggested child and therapist characteristics predicted use of practices derived from the evidence-base (PDEB) and use of practices with minimal evidence support (PMES). Longer episode length predicted greater receipt of PDEB; older youth, males, and youth in out-of-home levels of care were more likely to receive PMES; and youth receiving an evidence-based treatment program were less likely to receive PMES. Professional specialty and theoretical orientation significantly predicted PDEB whereas therapist characteristics did not predict PMES. Implementation implications are discussed.

Symptom differentiation of anxiety and depression across youth development and clinic-referred/nonreferred samples: An examination of competing factor structures of the Child Behavior Checklist DSM-oriented scales.

This study examined the psychometric properties of the DSM-oriented scales of the Child Behavior Checklist (Achenbach, Dumenci, & Rescorla, 2003) using confirmatory factor analysis to compare the six-factor structure of the DSM-oriented scales to competing models consistent with developmental theories of symptom differentiation. We tested these models on both clinic-referred (N = 757) and school-based, nonreferred (N = 713) samples of youths in order to assess the generalizability of the factorial structures. Although previous research has supported the fit of the six-factor DSM-oriented structure in a normative sample of youths ages 7 to 18 (Achenbach & Rescorla, 2001), tripartite model research indicates that anxiety and depressive symptomology are less differentiated among children compared to adolescents (Jacques & Mash, 2004). We thus examined the relative fit of a six- and a five-factor model (collapsing anxiety and depression) with younger (ages 7-10) and older (ages 11-18) youth subsamples. The results revealed that the six-factor model fit the best in all samples except among younger nonclinical children. The results extended the generalizability of the rationally derived six-factor structure of the DSM-oriented scales to clinic-referred youths and provided further support to the notion that younger children in nonclinical samples exhibit less differentiated symptoms of anxiety and depression.

Engineering Youth Service System Infrastructure: Hawaii's Continued Efforts at Large-Scale Implementation Through Knowledge Management Strategies

Hawaiis Child and Adolescent Mental Health Division provides a unique illustration of a youth public mental health system with a long and successful history of large-scale quality improvement initiatives. Many advances are linked to flexibly organizing and applying knowledge gained from the scientific literature and move beyond installing a limited number of brand-named treatment approaches that might be directly relevant only to a small handful of system youth. This article takes a knowledge-to-action perspective and outlines five knowledge management strategies currently under way in Hawaii. Each strategy represents one component of a larger coordinated effort at engineering a service system focused on delivering both brand-named treatment approaches and complimentary strategies informed by the evidence base. The five knowledge management examples are (a) a set of modular-based professional training activities for currently practicing therapists, (b) an outreach initiative for supporting youth evidence-based practices training at Hawaiis mental health-related professional programs, (c) an effort to increase consumer knowledge of and demand for youth evidence-based practices, (d) a practice and progress agency performance feedback system, and (e) a sampling of system-level research studies focused on understanding treatment as usual. We end by outlining a small set of lessons learned and a longer term vision for embedding these efforts into the systems infrastructure.