Megan M. Fredrick

The Cultural Adaptability of Intermediate Measures of Functional Outcome in Schizophrenia

The Measurement and Treatment Research to Improve Cognition in Schizophrenia initiative was designed to encourage the development of cognitive enhancing agents for schizophrenia. For a medication to receive this indication, regulatory agencies require evidence of improvement in both cognition and functional outcome. Because medication trials are conducted across multiple countries, we examined ratings of the cross-cultural adaptability of 4 intermediate measures of functional outcome (Independent Living Scales, UCSD Performance-based Skills Assessment, Test of Adaptive Behavior in Schizophrenia, Cognitive Assessment Interview [CAI]) made by experienced clinical researchers at 31 sites in 8 countries. English-speaking research staff familiar with conducting medication trials rated the extent to which each subscale of each intermediate measure could be applied to their culture and to subgroups within their culture based on gender, geographic region, ethnicity, and socioeconomic status on the Cultural Adaptation Rating Scale. Ratings suggested that the CAI would be easiest to adapt across cultures. However, in a recent study, the CAI was found to have weaker psychometric properties than some of the other measures. Problems were identified for specific subscales on all the performance-based assessments across multiple countries. India, China, and Mexico presented the greatest challenges in adaptation. For international clinical trials, it would be important to use the measures that are most adaptable, to adapt subscales that are problematic for specific countries or regions, or to develop a battery composed of the subscales from different instruments that may be most acceptable across multiple cultures with minimal adaptation.

The Reliability and Validity of the MATRICS Functional Assessment Battery

OBJECTIVES The Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative was designed to encourage the development of cognitive enhancing agents for schizophrenia. For a medication to receive this indication, regulatory agencies require evidence of improvement in both cognition and functional outcome. Functional capacity measures typically used in clinical trials as intermediate measures of functional outcome must be adapted to fit different cultural contexts for use internationally. We examined the psychometric properties of the MATRICS Functional Assessment Battery (MFAB), comprised of 2 subtests from the UCSD Performance-based Skills Assessment (UPSA) and one from the Test of Adaptive Behavior in Schizophrenia (TABS) that were rated by experts in a previous study to be the most appropriate functional capacity assessments across different cultural contexts. METHOD Four sites in India administered the MFAB, a brief version of the UPSA, the MATRICS Cognitive Consensus Battery, measures of symptomatology, and a measure of global functional outcome to 141 individuals with schizophrenia at a baseline assessment and at 4 weeks later. RESULTS Test-retest reliability based on the intraclass correlation coefficient was significantly better for the UCSD Performance-Based Skills Assessment-Brief (UPSA-B). Pearson correlation coefficients over time were not significantly different for the 2 measures. Only the MFAB was significantly correlated with functional outcome as measured by the Specific Levels of Functioning Scale. CONCLUSIONS The psychometric properties of the MFAB and UPSA-B were similar. The MATRICS scientific board chose to translate the MFAB into multiple languages for potential use in studies of novel medications seeking an indication for improving cognition in schizophrenia.

A qualitative assessment of cross-cultural adaptation of intermediate measures for schizophrenia in multisite international studies.

In this substudy of the Measurement and Treatment Research to Improve Cognition in Schizophrenia we examined qualitative feedback on the cross-cultural adaptability of four intermediate measures of functional outcome (Independent Living Scales, UCSD Performance-Based Skills Assessment, Test of Adaptive Behavior in Schizophrenia, and Cognitive Assessment Interview). Feedback was provided by experienced English-fluent clinical researchers at 31 sites in eight countries familiar with medication trials. Researchers provided feedback on test subscales and items which were rated as having adaptation challenges. They noted the specific concern and made suggestions for adaptation to their culture. We analyzed the qualitative data using a modified Grounded Theory approach guided by the International Testing Commission Guidelines model for test adaptation. For each measure except the Cognitive Assessment Interview (CAI), the majority of subscales were reported to require major adaptations in terms of content and concepts contained in the subscale. In particular, social, financial, transportation and health care systems varied widely across countries-systems which are often used to assess performance capacity in the U.S. We provide suggestions for how to address future international test development and adaptation.

What Patients With Severe Mental Illness Transitioning From Hospital to Community Have to Say About Care and Shared Decision-Making

Shared decision-making (SDM) has been slow to disseminate in mental health. We conducted focus groups with ten individuals with serious mental illness (SMI) treated in a 90 day, outpatient transitional care clinic. Parallel groups were held with family caregivers (n = 8). Individuals with SMI wanted longer visits, to have their stories heard, more information about options presented simply, to hear from peers about similar experiences, and a bigger say in treatment choices. Caregivers wanted to be invited to participate to a larger extent. Results suggest that after a decade, SDM may not have the expected penetration in community mental health.

Is cognitive adaptation training (CAT) compensatory, restorative, or both?

Cognitive adaptation training (CAT) is a psychosocial treatment incorporating environmental supports including signs, checklists to bypass the cognitive deficits of schizophrenia. Our objective was to examine the association between CAT, functional outcomes, and cognitive test performance (cognition). The two research questions were as follows: 1) Does cognition mediate the effect of CAT intervention on functional outcome? 2) Does CAT impact cognitive test performance? A total of 120 participants with schizophrenia were randomized to one of three treatments: 1) CAT (weekly for 9months; monthly thereafter), 2) generic environmental supports (given to participants on clinic visits to promote adaptive behavior), or 3) treatment as usual (TAU). Assessments of cognition and functional outcome were conducted at baseline, 9 and 24months. Mediation analyses and mixed effects regression were conducted. Mediation analyses revealed that during the initial 9months, the direct path from treatment group to functional outcome on the primary measure was positive and highly significant. CAT significantly improved functional outcome compared to the other treatments. However, paths involving cognition were negligible. There was no evidence that cognition mediated improvement in functional outcomes. At 24months, cognition improved more in CAT compared to other treatment groups. The test for cognition mediating improvement in functional outcomes was not significant at this time point. However, improvement in functional outcome led to better performance on cognitive testing. We concluded that improvement in cognition is not a necessary condition for improvement in functional outcome and that greater engagement in functional behavior has a positive impact on cognition.

The Daily Activity Report (DAR) a Novel Measure of Functional Outcome for Serious Mental Illness

The assessment of real-world functional outcomes in clinical trials for medications targeting negative symptoms and cognitive impairment is extremely important. We tested the psychometric properties of the Daily Activity Report (DAR), a novel assessment of productive daily activity. We administered the DAR and additional assessments of functional outcome, functional capacity, cognition and symptomatology to 50 individuals with schizophrenia at 2 time points, 1 month apart and to 25 healthy controls. The DAR records a person’s daily activity for 7 consecutive days based upon phone calls made 3 times a day. A total score and scores in 3 domains; instrumental activities (ie, independent living), social and work or school related activities are generated for the DAR. Inter-item consistency was high 0.89–0.94 for each domain and 0.88 overall. Test–retest reliability across 1 month for the total DAR score was 0.67, P < .0001. The total DAR score as well as scores for social activity and nondomestic work/school differed significantly between control and patient participants (P < .0001). DAR domain scores were associated with negative symptoms and functional outcomes, but the primary score related to these measures was the work/school dimension of the DAR. DAR scores were only weakly and nonsignificantly related to positive symptoms. This study provides preliminary support for the reliability and validity of the DAR using interviewer administration. The development of a patient reported version of the DAR using smart phone technology with automatic scoring is the next step.

The Use of Access Groups for Engagement in Community Mental Health Post Hospitalization

This paper describes a novel approach to engaging psychiatric patients in care after discharge from inpatient or ER treatment. The Access Group model provides rapid, flexible, high-volume intake for up to 20 patient referrals per day. Patients are scheduled for intake by referring hospital clinicians using an online scheduling software and can be seen within 1–3 days of hospital discharge. Access allows flexibility, easy rescheduling, and limited wait time. At intake, patients and family members participate in a structured group intake procedure from which they are scheduled for follow-up psychiatry, therapy, and social work appointments. Same-day appointments are available for urgent needs. Initial evidence suggests that the Access Group model is effective at providing rapid access to and engagement in care, and is acceptable to patients. Generalizability and funding approaches for the model are discussed.

Engagement-focused care during transitions from inpatient and emergency psychiatric facilities

Objectives As many as 40% of those with serious mental illness (SMI) do not attend any outpatient visits in the 30 days following discharge. We examined engagement-focused care (EFC) versus treatment as usual in a university-based transitional care clinic (TCC) with a 90-day program serving individuals with SMI discharged from hospitals and emergency rooms. EFC included a unique group intake process (access group) designed to get individuals into care rapidly and a shared decision-making coach. Methods Assessments of quality of life, symptomatology, and shared decision-making preferences were conducted at baseline, at 3 months corresponding to the end of TCC treatment and 6 months after TCC discharge. Communication among the patients and providers was assessed at each visit as was service utilization during and after TCC. Results Subjective quality of life improved in EFC. Prescribers and patients saw communication more similarly as time went on. Ninety-one percent of patients wanted at least some say in decisions about their treatment. Conclusions SDM coaching and improved access improve quality of life. Most people want a say in treatment decisions.

Following AACP Guidelines for Transitions in Care: The Transitional Care Clinic

The period of transition from hospital to community services is critical for individuals with serious mental illness. The American Association of Community Psychiatry developed guidelines for transitional services in behavioral health care. This column describes ways in which the Transitional Care Clinic (TCC) at the University of Texas Health Science Center at San Antonio has implemented these guidelines. The TCC includes active outreach to hospitals and a Web-based referral system that allows hospital staff to make TCC appointments for patients for as soon as the day after discharge. The program includes a unique group intake process that allows rapid development of individualized plans while maximizing access to services and use of provider time.