Craig S. Schwalbe

A Meta-Analysis of Juvenile Justice Risk Assessment Instruments Predictive Validity by Gender

Juvenile justice systems have widely adopted risk assessment instruments to support judicial and administrative decisions about sanctioning severity and restrictiveness of care. A little explored property of these instruments is the extent to which their predictive validity generalizes across gender. The article reports on a meta-analysis of risk assessment predictive validity with male and female offenders. Nineteen studies encompassing 20 unique samples met inclusion criteria. Findings indicated that predictive validity estimates are equivalent for male and female offenders and are consistent with results of other meta-analyses in the field. The findings also indicate that when gender differences are observed in individual studies, they provide evidence for gender biases in juvenile justice decision-making and case processing rather than for the ineffectiveness of risk assessment with female offenders.

Psychiatric Disorder, Comorbidity, and Suicidal Behavior in Juvenile Justice Youth

Results of collaborations with juvenile justice agencies nationwide were examined to provide generalizable estimates of psychiatric disorder and suicidality among justice system youth. Diagnostic assessments were aggregated from 57 sites (N = 9,819) from an automated computer-assisted self-interview (Voice Diagnostic Interview Schedule for Children). Disorder was predicted from setting type (system intake, detention, corrections), adjusting for demographic and offense characteristics, and for cross-site variability within settings. Race by comorbid disorder interactions were examined in predicting substance use disorder (SUD). White youth, repeat offenders, and those with further justice system penetration reported higher rates of most disorders; girls reported higher rates of internalizing conditions only. Although presence of another disorder increased SUD for most groups, SUD was high in American Indians regardless of either affective disorder or recent suicide attempt. Findings highlight (a) varying mental health needs across settings, (b) prior justice contact relating strongly to need, (c) girls’ elevated rates of internalizing disorder, and (d) racial/ethnic differences in diagnostic profiles.

Classifying juvenile offenders according to risk of recidivism: Predictive validity, race/ethnicity, and gender

Structured risk assessment instruments are increasingly used in juvenile justice systems to support judicial decision making. They help juvenile justice authorities identify youths with a higher likelihood of repeat delinquency and reduce discretion associated with disposition decision making. To be effective, these instruments should be accurate across diverse populations. This study describes the predictive validity of the North Carolina Assessment of Risk (NCAR) in a sample of 9,534 adjudicated juveniles in North Carolina. Results show the predictive validity of the NCAR to differ by gender and race/ethnicity. Closer inspection reveals that risk factors for recidivism differed according to demographic group and that brief risk assessment instruments such as the NCAR leave other risk factors unmeasured. The results support the utility of risk assessment for juvenile justice decision making and suggest strategies to improve the validity of risk assessment for all offender groups.

A meta-analysis of experimental studies of diversion programs for juvenile offenders

OBJECTIVE Research to establish an evidence-base for the treatment of conduct problems and delinquency in adolescence is well established; however, an evidence-base for interventions with offenders who are diverted from the juvenile justice system has yet to be synthesized. The purpose of this study was to conduct a meta-analysis of experimental studies testing juvenile diversion programs and to examine the moderating effect of program type and implementation quality. METHOD A literature search using PsycINFO, Web of Science, and the National Criminal Justice Reference Service data-bases and research institute websites yielded 28 eligible studies involving 57 experimental comparisons and 19,301 youths. RESULTS Recidivism was the most common outcome reported across all studies. Overall, the effect of diversion programs on recidivism was non-significant (k=45, OR=0.83, 95%CI=0.43-1.58). Of the five program types identified, including case management (k=18, OR=0.78), individual treatment (k=11, OR=0.83), family treatment (k=4, OR=0.57), youth court (k=6, OR=0.93), and restorative justice (k=6, OR=0.87), only family treatment led to a statistically significant reduction in recidivism. Restorative justice studies that were implemented with active involvement of researchers led to statistically significant reductions in recidivism (k=3, OR=0.69). Other outcomes, including frequency of offending, truancy, and psycho-social problems were reported infrequently and were not subjected to meta-analysis. CONCLUSIONS High levels of heterogeneity characterize diversion research. Results of this study recommend against implementation of programs limited to case management and highlight the promise of family interventions and restorative justice.

The Contribution of Psychiatric Disorder to Juvenile Recidivism

Youths formally referred to probation authorities in Texas (791 male, 200 female) self-administered a structured diagnostic interview at intake. Data on demographics, offense characteristics, and reoffending (within 12 months of baseline) were extracted from official justice records. Logistic regression analyses were used to evaluate the contribution of diagnosis to recidivism, adjusting for demographic and offense characteristics. Baseline externalizing disorders were associated with increased recidivism risk for both genders, whereas youths’ recidivism risk was not influenced by anxiety disorder. Girls with comorbid substance use and affective disorder were nearly four times more likely to reoffend than girls with no disorder. In contrast, among males, this disorder profile was associated with only approximately half the level of recidivism risk. Results substantiate practice guidelines that recommend comprehensive mental health assessment in juvenile justice settings and identify youths with certain mental health needs who might be well served by diversion programs.

Sustaining motivational interviewing: a meta-analysis of training studies

BACKGROUND AND AIMS Previous research indicates that motivational interviewing (MI) skills decline over time among participants in training workshops when post-workshop feedback and coaching are not provided. This study explored moderators of skill retention among trainees learning MI mainly for substance use disorder treatment in real-world treatment settings, including workshop enhancements and type and dose of post-workshop feedback and coaching. METHODS A meta-analysis of training studies was conducted with studies that reported MI skills using observational measures and that included trainees from real-world agency settings. Standardized change scores were calculated to indicate the magnitude of pre-post training change in MI skills; standardized change scores from post-training to 3 and 6+ months follow-up were calculated to indicate the sustainability of training gains over time. Effect sizes were aggregated using random effects models. RESULTS Twenty-one papers that reported the effects of MI training on agency staff were included in this review. Across studies, training yielded gains in MI skills (d = 0.76). Studies that did not include feedback and/or coaching reported eroding skills over a 6-month follow-up (d = -0.30), whereas post-workshop feedback/coaching sustained skills (d = 0.03). Effects of post-workshop feedback/coaching were moderated by frequency, duration and length of training. Moreover, studies reporting low levels of attrition from training protocols showed small increases in skills over the 6-month follow-up period (d = 0.12), whereas studies with high attrition showed skill erosion (d = -0.29). CONCLUSIONS On average, three to four feedback/coaching sessions over a 6-month period sustain skills among trainees for motivational interviewing, mainly for substance use disorder treatment. However, high rates of attrition from feedback/coaching contributes to post-workshop skill erosion.

North Carolina Assessment of Risk (NCAR): Reliability and Predictive Validity with Juvenile Offenders.

Abstract Actuarial risk assessment instruments are used increasingly in juvenile justice to classify youths according to their risk of recidivism. The purpose of this article is to describe the results of two studies of one instrument: the North Carolina Assessment of Risk (NCAR). In the first study, the inter-rater reliability of the risk assessment instrument was estimated with a sample of 175 court counselors who rated videotaped vignettes of juvenile offenders. In the second study, predictive validity was assessed prospectively by following a statewide sample of 464 delinquent youths for 12 months. Findings indicate that the risk assessment instrument increases reliability as compared to clinical judgment. Moreover, risk scores are correlated significantly with rearrest. However, analyses also show that relationships between risk scores and recidivism vary for subgroups based on gender and race/ethnicity. Though challenges remain in improving the accuracy of risk assessment, the findings suggest that actuarial assessment can be a valuable tool to support decision making in juvenile justice.

Predictive validity of the joint risk matrix with juvenile offenders: a focus on gender and race/ethnicity

Actuarial risk assessment instruments promise to increase decision-making accuracy and equity in settings such as the juvenile justice system, but both aims presume high levels of predictive validity. Prior research suggests that the predictive validity of some juvenile justice risk assessment instruments differs across gender and race/ethnicity. The Joint Risk Matrix (JRM) described herein is an instrument developed to increase the predictive validity of risk assessment for the diverse populations served by the nation’s juvenile courts. The predictive validity of the JRM was estimated on a sample of 536 court-involved juveniles. The instrument demonstrated acceptable levels of validity across all juveniles (AUC = .710). Gender-based differences were explained by gendered patterns of referral to out-of-home placements. Differences by race/ethnicity were reduced compared with previous reports. The findings suggest that risk assessment can be improved by including measures related to the behavior and demeanor of offenders and the cooperation of their parents or caretakers.

Investigating Probation Strategies with Juvenile Offenders: The Influence of Officers' Attitudes and Youth Characteristics

Probation officers are the focal point for most interventions with delinquent youths in the juvenile justice system. The present study examines probation strategies and interventions in a sample of 308 probation officers who completed the Probation Practices Assessment Survey (PPAS) in a web-based survey. The PPAS measures six probation approaches: deterrence, restorative justice, treatment, confrontation, counseling, and behavioral tactics. Structural equation models and latent class analyses showed that probation officers use multiple approaches with delinquent youths consistent with the balanced and restorative justice movement. Younger youths, high-risk youths, and youths with prior social service involvements are likely to receive more intensive interventions. The implications of these findings for improving probation practices with delinquent youth are discussed.

Adaptation and translation of mental health interventions in Middle Eastern Arab countries: A systematic review of barriers to and strategies for effective treatment implementation:

Aim: All too often, efficacious psychosocial evidence-based interventions fail when adapted from one culture to another. International translation requires a deep understanding of the local culture, nuanced differences within a culture, established service practices, and knowledge of obstacles and promoters to treatment implementation. This research investigated the following objectives to better facilitate cultural adaptation and translation of psychosocial and mental health treatments in Arab countries: (1) identify barriers or obstacles; (2) identify promoting strategies; and (3) provide clinical and research recommendations. Methods: This systematic review of 22 psychosocial or mental health studies in Middle East Arab countries identified more barriers (68%) than promoters (32%) to effective translation and adaptation of empirically supported psychosocial interventions. Results: Identified barriers include obstacles related to acceptability of the intervention within the cultural context, community and system difficulties, and problems with clinical engagement processes. Whereas identified promoter strategies centre on the importance of partnering and working within the local and cultural context, the need to engage with acceptable and traditional intervention characteristics, and the development of culturally appropriate treatment strategies and techniques. Conclusions: Although Arab cultures across the Middle East are unique, this article provides a series of core clinical and research recommendations to assist effective treatment adaptation and translation within Arab communities in the Middle East.