Andrea Acevedo

Adapting Washington Circle performance measures for public sector substance abuse treatment systems

The Washington Circle, a group focused on developing and disseminating performance measures for substance abuse services, developed three such measures for private health plans. In this article, we explore whether these measures are appropriate for meeting measurement goals in the public sector and feasible to calculate in the public sector using data collected for administrative purposes by state and local substance abuse and/or mental health agencies. Working collaboratively, 12 states specified revised measures and 6 states pilot tested them. Two measures were retained from the original specifications: initiation of treatment and treatment engagement. Additional measures were focused on continuity of care after assessment, detoxification, residential or inpatient care. These data demonstrate that state agencies can calculate performance measures from routinely available information and that there is wide variability in these indicators. Ongoing research is needed to examine the reasons for these results, which might include lack of patient interest or commitment, need for quality improvement efforts, or financial issues.

Engagement in Outpatient Substance Abuse Treatment and Employment Outcomes

This study, a collaboration between an academic research center and Washington State’s health, employment, and correction departments, investigates the extent to which treatment engagement, a widely adopted performance measure, is associated with employment, an important outcome for individuals receiving treatment for substance use disorders. Two-stage Heckman probit regressions were conducted using 2008 administrative data for 7,570 adults receiving publicly funded treatment. The first stage predicted employment in the year following the first treatment visit, and three separate second-stage models predicted the number of quarters employed, wages, and hours worked. Engagement as a main effect was not significant for any of the employment outcomes. However, for clients with prior criminal justice involvement, engagement was associated with both employment and higher wages following treatment. Clients with criminal justice involvement face greater challenge regarding employment, so the identification of any actionable step which increases the likelihood of employment or wages is an important result.

Adolescent treatment initiation and engagement in an evidence-based practice initiative

This study examined client and program factors predicting initiation and engagement for 2,191 adolescents at 28 outpatient substance abuse treatment sites implementing evidence-based treatments. Using Washington Circle criteria for treatment initiation and engagement, 76% of the sample initiated, with 59% engaging in treatment. Analyses used a 2-stage Heckman probit regression, accounting for within-site clustering, to identify factors predictive of initiation and engagement. Adolescents treated in a pay-for-performance (P4P) group were more likely to initiate, whereas adolescents in the race/ethnicity category labeled other (Native American, Asian, Pacific Islander, Native Alaskan, Native Hawaiian, mixed race/ethnicity), or who reported high truancy, were less likely to initiate. Race/ethnicity groups other than Latinos were equally likely to engage. Among White adolescents, each additional day from first treatment to next treatment reduced likelihood of engagement. Although relatively high initiation and engagement rates were achieved, the results suggest that attention to program and client factors may further improve compliance with these performance indicators.

A Performance Measure for Continuity of Care After Detoxification: Relationship With Outcomes

Administrative data from five states were used to examine whether continuity of specialty substance abuse treatment after detoxification predicts outcomes. We examined the influence of a 14-day continuity of care process measure on readmissions. Across multiple states, there was support that clients who received treatment for substance use disorders within 14-days after discharge from detoxification were less likely to be readmitted to detoxification. This was particularly true for reducing readmissions to another detoxification that was not followed with treatment and when continuity of care was in residential treatment. Continuity of care in outpatient treatment was related to a reduction in readmissions in some states, but not as often as when continuity of care occurred in residential treatment. A performance measure for continuity of care after detoxification is a useful tool to help providers monitor quality of care delivered and to alert them when improvement is needed.

Performance measures for substance use disorders--what research is needed?

In 2010, the Washington Circle convened a meeting, supported by the National Institute on Drug Abuse (NIDA) and the Substance Abuse and Mental Health Services Administration (SAMHSA), for a multidisciplinary group of experts to focus on the research gaps in performance measures for substance use disorders. This article presents recommendations in three areas: development of new performance measures; methodological and other considerations in using performance measures; and implementation research focused on using performance measures for accountability and quality improvement.

Choosing a Nursing Home: What Do Consumers Want to Know, and Do Preferences Vary across Race/Ethnicity?

OBJECTIVE To identify what consumers want to know about nursing homes (NHs) before choosing one and to determine whether information preferences vary across race/ethnicity. DATA SOURCES/STUDY SETTING Primary data were collected in Greater Boston (January 2013-February 2014) from community-dwelling, white, black, and Latino adults aged 65+ and 40-64 years, who had personal/familial experience with a NH admission or concerns about one. STUDY DESIGN Eleven focus groups and 30 interviews were conducted separately by race/ethnicity and age group. PRINCIPAL FINDINGS Participants wanted detailed information on the facility, policies, staff, and residents, such as location, staff treatment of residents, and resident conditions. They wanted a sense of the NH gestalt and were interested in feedback/reviews from residents/families. Black and Latino participants were especially interested in resident and staff racial/ethnic concordance and facility cultural sensitivity. Latino participants wanted information on staff and resident language concordance. CONCLUSIONS Consumers want more information about NHs than what is currently available from resources like Nursing Home Compare. Report card makers can use these results to enhance their websites, and they should consider the distinct needs of different racial/ethnic groups. Future research should test methods for collecting and reporting resident and family feedback/reviews.

The Relationship Between Substance Abuse Performance Measures and Mutual-Help Group Participation after Treatment

The authors examined the relationship between treatment quality, using during-treatment process measures, and mutual-help group (e.g., Alcoholics Anonymous) attendance after outpatient substance use disorder (SUD) treatment for 739 clients in the Alcohol and Drug Services Study. Logistic regression models estimated any and regular mutual-help attendance after treatment. Clients referred to mutual-help groups were significantly more likely to attend any mutual help after treatment. Results were mixed for facility offered mutual-help groups; treatment engagement and retention were not significant. These findings offer treatment providers further evidence of the importance of referring clients to post-treatment mutual-help groups, an effective, low-cost option.

Agency-level financial incentives and electronic reminders to improve continuity of care after discharge from residential treatment and detoxification

BACKGROUND Despite the importance of continuity of care after detoxification and residential treatment, many clients do not receive further treatment services after discharged. This study examined whether offering financial incentives and providing client-specific electronic reminders to treatment agencies lead to improved continuity of care after detoxification or residential treatment. METHODS Residential (N = 33) and detoxification agencies (N = 12) receiving public funding in Washington State were randomized into receiving one, both, or none (control group) of the interventions. Agencies assigned to incentives arms could earn financial rewards based on their continuity of care rates relative to a benchmark or based on improvement. Agencies assigned to electronic reminders arms received weekly information on recently discharged clients who had not yet received follow-up treatment. Difference-in-difference regressions controlling for client and agency characteristics tested the effectiveness of these interventions on continuity of care. RESULTS During the intervention period, 24,347 clients received detoxification services and 20,685 received residential treatment. Overall, neither financial incentives nor electronic reminders had an effect on the likelihood of continuity of care. The interventions did have an effect among residential treatment agencies which had higher continuity of care rates at baseline. CONCLUSIONS Implementation of agency-level financial incentives and electronic reminders did not result in improvements in continuity of care, except among higher performing agencies. Alternative strategies at the facility and systems levels should be explored to identify ways to increase continuity of care rates in specialty settings, especially for low performing agencies.

Examining Racial and Ethnic Differences in Nursing Home Quality

BACKGROUND Identifying racial/ethnic differences in quality is central to identifying, monitoring, and reducing disparities. Although disparities across all individual nursing home residents and disparities associated with between-nursing home differences have been established, little is known about the degree to which quality of care varies by race//ethnicity within nursing homes. A study was conducted to measure within-facility differences for a range of publicly reported nursing home quality measures. METHODS Resident assessment data on approximately 15,000 nursing homes and approximately 3 million residents (2009) were used to assess eight commonly used and publicly reported long-stay quality measures: the proportion of residents with weight loss, with high-risk and low-risk pressure ulcers, with incontinence, with depressive symptoms, in restraints daily, and who experienced a urinary tract infection or functional decline. Each measure was stratified by resident race/ethnicity (non-Hispanic white, non-Hispanic black, and Hispanic), and within-facility differences were examined. RESULTS Small but significant differences in care on average were found, often in an unexpected direction; in many cases, white residents were experiencing poorer outcomes than black and Hispanic residents in the same facility. However, a broad range of differences in care by race/ethnicity within nursing homes was also found. CONCLUSION The results suggest that care is delivered equally across all racial/ethnic groups in the same nursing home, on average. The results support the call for publicly reporting stratified nursing home quality measures and suggest that nursing home providers should attempt to identify racial/ethnic within-facility differences in care.

Disparities in the Treatment of Substance Use Disorders: Does Where You Live Matter?

This study focused on (1) whether disparities in timely receipt of substance use services can be explained in part by the characteristics of the community in which the clients reside and (2) whether the effect of community characteristics on timely receipt of services was similar across racial/ethnic groups. The sample was composed of adults receiving publicly funded outpatient treatment in Washington State. Treatment data were linked to data from the US census. The outcome studied was “Initiation and Engagement” in treatment (IET), a measure noting timely receipt of services at the beginning of treatment. Community characteristics studied included community level economic disadvantage and concentration of American Indian, Latino, and Black residents in the community. Black and American Indian clients were less likely to initiate or engage in treatment compared to non-Latino white clients, and American Indian clients living in economically disadvantaged communities were at even greater risk of not initiating treatment. Community economic disadvantage and racial/ethnic makeup of the community were associated with treatment initiation, but not engagement, although they did not entirely explain the disparities found in IET.