Kimberly Hoagwood

Maximizing the Implementation Quality of Evidence-Based Preventive Interventions in Schools: A Conceptual Framework

Increased availability of research-supported, school-based prevention programs, coupled with the growing national policy emphasis on use of evidence-based practices, has contributed to a shift in research priorities from efficacy to implementation and dissemination. A critical issue in moving research to practice is ensuring high-quality implementation of both the intervention model and the support system for sustaining it. The paper describes a three-level framework for considering the implementation quality of school-based interventions. Future directions for research on implementation are discussed.

The NIMH Blueprint for Change Report: Research Priorities in Child and Adolescent Mental Health

The National Institute of Mental Health established a special subgroup of its National Advisory Mental Health Council to review major research findings on child and adolescent psychiatric disorders over the past decade and to recommend research priorities for the next decade. This Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment published its report, titled Blueprint for Change: Research on Child and Adolescent Mental Health, in August 2001, and several new research announcements reflecting these new directions have been issued since that time. This article summarizes the rationale for and background to the report, its major conclusions, and the reasons why interdisciplinary and translational approaches to research questions in child and adolescent mental health will help to maximize scientific advances.

Psychometric Properties and U.S. National Norms of the Evidence-Based Practice Attitude Scale (EBPAS)

The Evidence-Based Practice Attitude Scale (EBPAS) assesses mental health and social service provider attitudes toward adopting evidence-based practices. Scores on the EBPAS derive from 4 subscales (i.e., Appeal, Requirements, Openness, and Divergence) as well as the total scale, and preliminary studies have linked EBPAS scores to clinic structure and policies, organizational culture and climate, and first-level leadership. EBPAS scores are also related to service provider characteristics, including age, education level, and level of professional development. The present study examined the factor structure, reliability, and norms of EBPAS scores in a sample of 1,089 mental health service providers from a nationwide sample drawn from 100 service institutions in 26 states in the United States. The study also examined associations of provider demographic characteristics with EBPAS subscale and total scores. Confirmatory factor analysis supported a second-order factor model, and reliability coefficients for the subscales ranged from .91 to .67 (total scale = .74). The study establishes national norms for the EBPAS so that comparisons can be drawn for U.S. local as well as international studies of attitudes toward evidence-based practices. The results suggest that the factor structure and reliability are likely generalizable to a variety of service provider contexts and different service settings and that the EBPAS subscales are associated with provider characteristics. Directions for future research are discussed.

Toward the Integration of Education and Mental Health in Schools

Education and mental health integration will be advanced when the goal of mental health includes effective schooling and the goal of effective schools includes the healthy functioning of students. To build a solid foundation for this reciprocal agenda, especially within the zeitgeist of recent educational reforms, a change in the fundamental framework within which school mental health is conceptualized is needed. This change involves acknowledging a new set of priorities, which include: the use of naturalistic resources within schools to implement and sustain effective supports for students’ learning and emotional/behavioral health; inclusion of integrated models to enhance learning and promote health; attention to improving outcomes for all students, including those with serious emotional/behavioral needs; and strengthening the active involvement of parents. A strong research agenda to support these new priorities is essential.

A meta-systems approach to evidence–based practice for children and adolescents

Improving outcomes for children and adolescents with mental health needs demands a broad meta-systemic orientation to overcome persistent problems in current service systems. Improving outcomes necessitates inclusion of current and emerging evidence about effective practices for the diverse population of youth and their families. Key components of the meta-system for children with emotional or behavioral needs include families, cultural norms and values, and service sectors such as schools, pediatric health centers, specialty mental health systems, juvenile justice systems, child protection services, and substance use treatment systems. We describe each component of the meta-system, noting challenges to the provision of evidence-based practice (EBP) and highlighting ways to optimize outcomes. Our focus is on the inclusion of evidence-based assessment and interventions, including prevention, within a developmentally driven and culturally responsive contextual model. Recommendations for addressing disparities in research funding and essential steps to foster communication and coordination of EBP across settings are provided.

Youth Top Problems: using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy.

OBJECTIVE To complement standardized measurement of symptoms, we developed and tested an efficient strategy for identifying (before treatment) and repeatedly assessing (during treatment) the problems identified as most important by caregivers and youths in psychotherapy. METHOD A total of 178 outpatient-referred youths, 7-13 years of age, and their caregivers separately identified the 3 problems of greatest concern to them at pretreatment and then rated the severity of those problems weekly during treatment. The Top Problems measure thus formed was evaluated for (a) whether it added to the information obtained through empirically derived standardized measures (e.g., the Child Behavior Checklist [CBCL; Achenbach & Rescorla, 2001] and the Youth Self-Report [YSR; Achenbach & Rescorla, 2001]) and (b) whether it met conventional psychometric standards. RESULTS The problems identified were significant and clinically relevant; most matched CBCL/YSR items while adding specificity. The top problems also complemented the information yield of the CBCL/YSR; for example, for 41% of caregivers and 79% of youths, the identified top problems did not correspond to any items of any narrowband scales in the clinical range. Evidence on test-retest reliability, convergent and discriminant validity, sensitivity to change, slope reliability, and the association of Top Problems slopes with standardized measure slopes supported the psychometric strength of the measure. CONCLUSIONS The Top Problems measure appears to be a psychometrically sound, client-guided approach that complements empirically derived standardized assessment; the approach can help focus attention and treatment planning on the problems that youths and caregivers consider most important and can generate evidence on trajectories of change in those problems during treatment.

Concordance Between Parent Reports of Children's Mental Health Services and Service Records: The Services Assessment for Children and Adolescents (SACA)

The concordance between parent reports of childrens mental health services and medical and administrative service records were assessed in a field test of the Services Assessment for Children and Adolescents (SACA) interview instrument. Service use reports from primary caregivers, usually mothers, for their childs emotional or behavioral problems were compared against inpatient, outpatient, and school records in St. Louis, one of the pilot sites for the Multi-Site Study of Service Use, Need, Outcomes and Costs in Child and Adolescent Populations (UNOCCAP). A global “any use” service variable, comprised of inpatient, outpatient, and school reports, yielded an overall service use concordance kappa of .76 between parent reports and records. Parent reports of inpatient hospitalization services using the SACA yielded the highest agreement with medical records, with kappa statistics of 1.00 for use of any inpatient hospital care and for medication use. Parent reports of specific inpatient services concurred with medical records more moderately, yielding kappas from .50 to .66. Reports of any outpatient mental health services yielded variable rates of agreement, with kappas ranging from .67 for any use of outpatient care, to .66 for medication use, to negligible kappas for specific treatments. Parent reports of school services were weakly related to records for most services, except for moderate agreement (.48) on placement in special classrooms for emotional or behavioral problems. Family burden or impact discriminated more powerfully than other variables between respondents who concurred with records and those who did not.

Time-dependent changes in positively biased self-perceptions of children with attention-deficit/hyperactivity disorder: A developmental psychopathology perspective

This study examined changes in the degree of positive bias in self-perceptions of previously diagnosed 8- to 13-year-old children with attention-deficit/hyperactivity disorder (ADHD; n = 513) and comparison peers (n = 284) over a 6-year period. The dynamic association between biased self-perceptions and dimensional indices of depressive symptoms and aggression also were considered. Across the 6-year time span, comparison children exhibited less bias than children with ADHD, although a normative bolstering of social self-views during early adolescence was observed. Decreases in positive biases regarding social and behavioral competence were associated with increases in depressive symptoms over time, whereas increases in levels of positively biased self-perceptions in the behavioral (but not social) domain were predictive of greater aggression over time. ADHD status moderated the dynamic association between biases and adjustment. Finally, evidence indicated that there was a bidirectional relationship between biases and aggression, whereas depressive symptoms appeared to inversely predict later bias.

Medication management of stimulants in pediatric practice settings: A national perspective

&NA; Using a nationally representative sample of office‐based physicians, the management practices of pediatricians, psychiatrists, and family practice physicians were investigated. The major aims were to determine (1) what types of services these physicians were providing to children who received stimulants, (2) what factors predicted receipt of stimulants, and (3) whether these practices were concordant or discordant with professional consensus on diagnosis and treatment of attention‐deficit hyperactivity disorders (ADHD). Prescribing and management practice data from the 1995 National Ambulatory Medical Care Survey (NAMCS) were analyzed for children ages 0 to 17 years who were seen for psychiatric problems and received stimulant medication. Results indicated that 2 million visits by children were made in 1995 to psychiatrists, pediatricians, or family practitioners in which psychotropic medications were prescribed. In pediatric visits where stimulant medication was prescribed, mental health counseling was provided 47.3% of the time and psychotherapy 21.6%. Follow‐up arrangements were made in 79.1% of the visits. Psychiatrists were significantly more likely to provide psychotherapy and to specify follow‐up visits than were pediatricians, but less likely to provide other health counseling. Controlling for demographic and physician effects, the factors with the most significant effect on the probability of receiving stimulants were geographic region (living in the South), race (being white), receiving mental health counseling, not receiving psychotherapy, and having health insurance. Less than 50% of pediatric visits for psychiatric reasons involving stimulant medications included any form of psychosocial intervention. In 21% of these visits, no recommendations were made for follow‐up care. These practices diverge from National Institutes of Health (NIH) consensus panel recommendations and association‐issued practice parameters.

Overcoming barriers to reducing the burden of affective disorders

Affective disorders impose a substantial individual and societal burden. Despite availability of efficacious treatments and practice guidelines, unmet need remains high. To reduce unmet need and the burden of affective disorders, information is needed on the distribution of burden across stakeholders, on barriers to reducing burden, and on interventions that effectively reduce burden at the levels of practice, community, and policy. This article provides the report of the Working Group on Overcoming Barriers to Reducing the Burden of Affective Disorders, for the National Institute of Mental Health Strategic Plan on Mood Disorders. We review the literature, identify key gaps, and recommend new research to guide national efforts to reduce the burden of affective disorders.