Ramesh Raghavan

Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda.

An unresolved issue in the field of implementation research is how to conceptualize and evaluate successful implementation. This paper advances the concept of “implementation outcomes” distinct from service system and clinical treatment outcomes. This paper proposes a heuristic, working “taxonomy” of eight conceptually distinct implementation outcomes—acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability—along with their nominal definitions. We propose a two-pronged agenda for research on implementation outcomes. Conceptualizing and measuring implementation outcomes will advance understanding of implementation processes, enhance efficiency in implementation research, and pave the way for studies of the comparative effectiveness of implementation strategies.

Pediatric to Adult Mental Health Service Use of Young People Leaving the Foster Care System

PURPOSE To assess and predict changes in mental health service use as older youth leave the foster care system. METHODS Participants were 325 19-year-olds participating in a longitudinal study of older youth leaving the foster care system in Missouri. All were in the foster care system at age 17. Participants were interviewed nine times between their 17th and 19th birthdays using the Service Assessment for Children and Adolescents and a history calendar to improve recall of service history. Analyses included Cox proportional hazards regression to predict time to service stoppage and McNemars test to assess difference in rates of service use between age 17 and 19. RESULTS Mental health service use dropped dramatically across the study period for all services. Service rates dropped most steeply for youth who left the foster care system. Service use rates declined by roughly 60% from the month prior to leaving the foster care system to the month after leaving the system. Most young adults who stopped pharmacotherapy following discharge from foster care reported they did so of their own volition. CONCLUSIONS Practitioners should be aware of the possibility of patient-initiated mental health service discontinuation following exit from the foster care system and plan accordingly.

Toward a policy ecology of implementation of evidence-based practices in public mental health settings

BackgroundMental health policymaking to support the implementation of evidence-based practices (EBPs) largely has been directed toward clinicians. However, implementation is known to be dependent upon a broader ecology of service delivery. Hence, focusing exclusively on individual clinicians as targets of implementation is unlikely to result in sustainable and widespread implementation of EBPs.DiscussionPolicymaking that is informed by the implementation literature requires that policymakers deploy strategies across multiple levels of the ecology of implementation. At the organizational level, policies are needed to resource the added marginal costs of EBPs, and to assist organizational learning by re-engineering continuing education units. At the payor and regulatory levels, policies are needed to creatively utilize contractual mechanisms, develop disease management programs and similar comprehensive care management approaches, carefully utilize provider and organizational profiling, and develop outcomes assessment. At the political level, legislation is required to promote mental health parity, reduce discrimination, and support loan forgiveness programs. Regulations are also needed to enhance consumer and family engagement in an EBP agenda. And at the social level, approaches to combat stigma are needed to ensure that individuals with mental health need access services.SummaryThe implementation literature suggests that a single policy decision, such as mandating a specific EBP, is unlikely to result in sustainable implementation. Policymaking that addresses in an integrated way the ecology of implementation at the levels of provider organizations, governmental regulatory agencies, and their surrounding political and societal milieu is required to successfully and sustainably implement EBPs over the long term.

A Preliminary Analysis of the Receipt of Mental Health Services Consistent With National Standards Among Children in the Child Welfare System

OBJECTIVES We sought to examine the extent to which children in the child welfare system receive mental health care consistent with national standards. METHODS We used data from 4 waves (3 years of follow-up) of the National Survey of Child and Adolescent Well-Being, the nations first longitudinal study of children in the child welfare system, and the Area Resource File to examine rates of screening, assessment, and referral to mental health services among 3802 youths presenting to child welfare agencies. Weighted population-averaged logistic regression models were used to identify variables associated with standards-consistent care. RESULTS Only half of all children in the sample received care consistent with any 1 national standard, and less than one tenth received care consistent with all of them. Older children, those exhibiting externalizing behaviors, and those placed in foster care had, on average, higher odds of receiving care consistent with national standards. CONCLUSIONS Adverse consequences of childhood disadvantage cannot be reduced unless greater collaboration occurs between child welfare and mental health agencies. Current changes to Medicaid regulations that weaken entitlements to screening and assessment may also worsen mental health disparities among these vulnerable children.

Administrative Barriers to the Adoption of High-Quality Mental Health Services for Children in Foster Care: A National Study

While the need to provide appropriate mental health services to children in foster care is well recognized, there is little information on administrative barriers to assuring that such services are provided. This article presents results from a national survey of mental health agencies to profile their awareness of currently available practice standards, the roles these standards play in guiding practice of mental health agencies, common reimbursement strategies in use for mental health services, and collaborations between mental health and child welfare agencies that enhance children’s access to appropriate mental health care. Implications and recommendations for mental health policymakers are discussed.

Use of Multiple Psychotropic Medications Among Adolescents Aging Out of Foster Care

OBJECTIVES This study described the prevalence of and risk factors for using multiple concurrent psychotropics among adolescents leaving foster care. METHODS In-person interviews were conducted with 406 adolescents who were aged 17 years and were leaving foster care in a Midwestern state. RESULTS Of the 403 who had complete records, most (N=257, or 64%) did not report taking any psychotropic medications, while 46 (10%) were on three or more concurrent psychotropics. A history of physical or sexual abuse and a diagnosis of major depressive disorder or manic episode were significantly associated with the use of three or more concurrent medications. Between 19% and 41% of adolescents with diagnoses for which psychotropics are indicated were not taking any medications. CONCLUSIONS This local cohort of adolescents aging out of foster care seemed to display both overuse and underuse of psychotropics. Research on larger and more representative cohorts of youths leaving foster care is necessary in order to understand the appropriateness of psychotropic prescribing among these adolescents.

Interstate variations in psychotropic medication use among a national sample of children in the child welfare system.

Geographic variations in service utilization have emerged as sentinels of quality of care. We used data from the National Survey of Child and Adolescent Well-Being (NSCAW), the Kaiser Family Foundation, and the Area Resource File to examine interstate variations in psychotropic medication use among children coming into contact with child welfare agencies. Mean probabilities of medication use differed by 13% between California (7.1%) and Texas (20.1%). On regression analyses, children in California had a fifth of the odds of medication use compared to children in Texas, principally, because child characteristics of age, gender, foster care placement, and mental health need seem to be evaluated differently in Texas compared to in other states. These findings suggest that interstate variations in psychotropic medication use are driven by child characteristics, rather than by mental health need. Understanding the clinical contexts of psychotropic medication use is necessary to assure high-quality care for these children.

Health Insurance Discontinuities Among Adolescents Leaving Foster Care

PURPOSE To determine whether adolescents who lose Medicaid entitlements when they leave foster care are subsequently able to secure employer-sponsored or student health insurance coverage. METHODS This was a 2-year follow-up study of a cohort of 404 adolescents leaving foster care in eight counties in a midwestern state. We conducted survival analysis to study predictors of time to first insurance loss, and logistic regression analysis to determine factors associated with insurance reacquisition, among these youth. RESULTS A total of 206 adolescents (51%) left foster care during follow up, of whom 138 (67%) lost health insurance coverage within a mean of 3 months of leaving foster care. Those who regained coverage (34; 17% of those leaving foster care) did so after a mean period of 8 months spent without insurance. Hazard of insurance loss was lower for employed adolescents (HR=.5; 95% CI=.4-.7; p < .0001), but only half of all adolescents leaving foster care reported being able to secure employment. Student health insurance did not reduce hazard of insurance loss. Boys had significantly lower odds of regaining insurance compared with girls (OR=.2, SE=.5, p=.003). CONCLUSIONS Most youth leaving the child welfare system seem unable to transition to other forms of health insurance coverage. Even those that do acquire coverage, do so after an inordinate period of time. Enacting existing extensions of Medicaid coverage until age 21 for foster care youth is necessary to provide the resources to address the considerable health and mental health needs among these youth.

A mixed methods multiple case study of implementation as usual in children's social service organizations: study protocol

BackgroundImproving quality in children’s mental health and social service settings will require implementation strategies capable of moving effective treatments and other innovations (e.g., assessment tools) into routine care. It is likely that efforts to identify, develop, and refine implementation strategies will be more successful if they are informed by relevant stakeholders and are responsive to the strengths and limitations of the contexts and implementation processes identified in usual care settings. This study will describe: the types of implementation strategies used; how organizational leaders make decisions about what to implement and how to approach the implementation process; organizational stakeholders’ perceptions of different implementation strategies; and the potential influence of organizational culture and climate on implementation strategy selection, implementation decision-making, and stakeholders’ perceptions of implementation strategies.Methods/designThis study is a mixed methods multiple case study of seven children’s social service organizations in one Midwestern city in the United States that compose the control group of a larger randomized controlled trial. Qualitative data will include semi-structured interviews with organizational leaders (e.g., CEOs/directors, clinical directors, program managers) and a review of documents (e.g., implementation and quality improvement plans, program manuals, etc.) that will shed light on implementation decision-making and specific implementation strategies that are used to implement new programs and practices. Additionally, focus groups with clinicians will explore their perceptions of a range of implementation strategies. This qualitative work will inform the development of a Web-based survey that will assess the perceived effectiveness, relative importance, acceptability, feasibility, and appropriateness of implementation strategies from the perspective of both clinicians and organizational leaders. Finally, the Organizational Social Context measure will be used to assess organizational culture and climate. Qualitative, quantitative, and mixed methods data will be analyzed and interpreted at the case level as well as across cases in order to highlight meaningful similarities, differences, and site-specific experiences.DiscussionThis study is designed to inform efforts to develop more effective implementation strategies by fully describing the implementation experiences of a sample of community-based organizations that provide mental health services to youth in one Midwestern city.

Psychotropic Drug Use Among Preschool Children in the Medicaid Program From 36 States

OBJECTIVES We determined the prevalence of and indications for psychotropic medication among preschool children in Medicaid. METHODS We obtained 2000 to 2003 Medicaid Analytic Extract data from 36 states. We followed children in 2 cohorts, born in 1999 and 2000, up to age 4 years. We used logistic regression to model odds of receiving medications for (1) attention-deficit disorder/attention-deficit hyperactivity disorder, (2) depression or anxiety, and (3) psychotic illness or bipolar. RESULTS Overall, 1.19% of children received at least 1 psychotropic drug. Medications for attention-deficit disorder/attention-deficit hyperactivity disorder treatment were most common (0.61% of all children), followed by depression or anxiety (0.59%) and psychotic illness or bipolar (0.24%). Among children, boys, those of other or unknown race compared with White, and those with other insurance compared with fee for service-only had higher odds of receiving a prescription (odds ratio [OR]=1.80 [95% confidence interval (CI)=1.74, 1.86], 1.75 [corrected] [1.66, 1.85], and 1.14 [1.01, 1.28], respectively), whereas Black and Hispanic children had lower odds (OR=0.51 [95% CI=0.48, 0.53] and 0.37 [0.34, 0.39], respectively). CONCLUSIONS Preschoolers are receiving psychotropic medications despite limited evidence supporting safety or efficacy. Future research should focus on implementing medication use practice parameters in infant and toddler clinics, and expanding psychosocial interventions for young children with behavioral problems.