James M. Gold

The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity.

OBJECTIVE The lack of an accepted standard for measuring cognitive change in schizophrenia has been a major obstacle to regulatory approval of cognition-enhancing treatments. A primary mandate of the National Institute of Mental Healths Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative was to develop a consensus cognitive battery for clinical trials of cognition-enhancing treatments for schizophrenia through a broadly based scientific evaluation of measures. METHOD The MATRICS Neurocognition Committee evaluated more than 90 tests in seven cognitive domains to identify the 36 most promising measures. A separate expert panel evaluated the degree to which each test met specific selection criteria. Twenty tests were selected as a beta battery. The beta battery was administered to 176 individuals with schizophrenia and readministered to 167 of them 4 weeks later so that the 20 tests could be compared directly. RESULTS The expert panel ratings are presented for the initially selected 36 tests. For the beta battery tests, data on test-retest reliability, practice effects, relationships to functional status, practicality, and tolerability are presented. Based on these data, 10 tests were selected to represent seven cognitive domains in the MATRICS Consensus Cognitive Battery. CONCLUSIONS The structured consensus method was a feasible and fair mechanism for choosing candidate tests, and direct comparison of beta battery tests in a common sample allowed selection of a final consensus battery. The MATRICS Consensus Cognitive Battery is expected to be the standard tool for assessing cognitive change in clinical trials of cognition-enhancing drugs for schizophrenia. It may also aid evaluation of cognitive remediation strategies.

Identification of separable cognitive factors in schizophrenia

One of the primary goals in the NIMH initiative to encourage development of new interventions for cognitive deficits in schizophrenia, Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS), has been to develop a reliable and valid consensus cognitive battery for use in clinical trials. Absence of such a battery has hampered standardized evaluation of new treatments and, in the case of pharmacological agents, has been an obstacle to FDA approval of medications targeting cognitive deficits in schizophrenia. A fundamental step in developing such a battery was to identify the major separable cognitive impairments in schizophrenia. As part of this effort, we evaluated the empirical evidence for cognitive performance dimensions in schizophrenia, emphasizing factor analytic studies. We concluded that seven separable cognitive factors were replicable across studies and represent fundamental dimensions of cognitive deficit in schizophrenia: Speed of Processing, Attention/Vigilance, Working Memory, Verbal Learning and Memory, Visual Learning and Memory, Reasoning and Problem Solving, and Verbal Comprehension. An eighth domain, Social Cognition, was added due to recent increased interest in this area and other evidence of its relevance for clinical trials aiming to evaluate the impact of potential cognitive enhancers on cognitive performance and functional outcome. Verbal Comprehension was not considered appropriate for a cognitive battery intended to be sensitive to cognitive change, due to its resistance to change. The remaining seven domains were recommended for inclusion in the MATRICS-NIMH consensus cognitive battery and will serve as the basic structure for that battery. These separable cognitive dimensions also have broader relevance to future research aimed at understanding the nature and structure of core cognitive deficits in schizophrenia.

Approaching a consensus cognitive battery for clinical trials in schizophrenia: The NIMH-MATRICS conference to select cognitive domains and test criteria

To stimulate the development of new drugs for the cognitive deficits of schizophrenia, the National Institute of Mental Health (NIMH) established the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative. This article presents an overview of decisions from the first MATRICS consensus conference. The goals of the meeting were to 1) identify the cognitive domains that should be represented in a consensus cognitive battery and 2) prioritize key criteria for selection of tests for the battery. Seven cognitive domains were selected based on a review of the literature and input from experts: working memory, attention/vigilance, verbal learning and memory, visual learning and memory, reasoning and problem solving, speed of processing, and social cognition. Based on discussions at this meeting, five criteria were considered essential for test selection: good test-retest reliability, high utility as a repeated measure, relationship to functional outcome, potential response to pharmacologic agents, and practicality/tolerability. The results from this meeting constitute the initial steps for reaching a consensus cognitive battery for clinical trials in schizophrenia.

The Brief Assessment of Cognition in Schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery.

Studies of neurocognitive function in patients with schizophrenia use widely variable assessment techniques. Clinical trials assessing the cognitive enhancing effect of new medications have used neurocognitive assessment batteries that differed in content, length and administration procedures. The Brief Assessment of Cognition in Schizophrenia (BACS) is a newly developed instrument that assesses the aspects of cognition found to be most impaired and most strongly correlated with outcome in patients with schizophrenia. The BACS requires less than 35 min to complete in patients with schizophrenia, yields a high completion rate in these patients, and has high reliability. The BACS was found to be as sensitive to cognitive impairment in patients with schizophrenia as a standard battery of tests that required over 2 h to administer. Compared to healthy controls matched for age and parental education, patients with schizophrenia performed 1.49 standard deviations lower on a composite score calculated from the BACS and 1.61 standard deviations lower on a composite score calculated from the standard battery. The BACS composite scores were highly correlated with the standard battery composite scores in patients (r=0.76) and healthy controls (r=0.90). These psychometric properties make the BACS a promising tool for assessing cognition repeatedly in patients with schizophrenia, especially in clinical trials of cognitive enhancement.

Physiological activation of a cortical network during performance of the Wisconsin Card Sorting Test: A positron emission tomography study

To determine the neural circuitry engaged by performance of the Wisconsin Card Sorting Test (WCST), a neuropsychological test traditionally considered to be sensitive to prefrontal lesions, regional cerebral blood flow was measured with oxygen-15 water and positron emission tomography (PET) while young normal subjects performed the test as well as while they performed a specially designed sensorimotor control task. To consider which of the various cognitive operations and other experiential phenomena involved in the WCST PET scan are critical for the pattern of physiological activation and to focus on the working memory component of the test, repeat WCST scans were also performed on nine of the subjects after instruction on the test and practice to criteria. We confirmed that performance of the WCST engages the frontal cortex and also produces activation of a complex network of regions consistently including the inferior parietal lobule but also involving the visual association and inferior temporal cortices as well as portions of the cerebellum. The WCST activation in the dorsolateral prefrontal cortex (DLPFC) remained significant even after training and practice on the test, suggesting that working memory may be largely responsible for the physiological response in DLPFC during the WCST and, conversely, that the DLPFC plays a major role in modulating working memory.

Baseline neurocognitive deficits in the CATIE schizophrenia trial

Neurocognition is moderately to severely impaired in patients with schizophrenia. However, the factor structure of the various neurocognitive deficits, the relationship with symptoms and other variables, and the minimum amount of testing required to determine an adequate composite score has not been determined in typical patients with schizophrenia. An ‘all-comer’ approach to cognition is needed, as provided by the baseline assessment of an unprecedented number of patients in the CATIE (Clinical Antipsychotic Trials of Intervention Effectiveness) schizophrenia trial. From academic sites and treatment providers representative of the community, 1493 patients with chronic schizophrenia were entered into the study, including those with medical comorbidity and substance abuse. Eleven neurocognitive tests were administered, resulting in 24 individual scores reduced to nine neurocognitive outcome measures, five domain scores and a composite score. Despite minimal screening procedures, 91.2% of patients provided meaningful neurocognitive data. Exploratory principal components analysis yielded one factor accounting for 45% of the test variance. Confirmatory factor analysis showed that a single-factor model comprised of five domain scores was the best fit. The correlations among the factors were medium to high, and scores on individual factors were very highly correlated with the single composite score. Neurocognitive deficits were modestly correlated with negative symptom severity (r=0.13–0.27), but correlations with positive symptom severity were near zero (r<0.08). Even in an ‘all-comer’ clinical trial, neurocognitive deficits can be assessed in the overwhelming majority of patients, and the severity of impairment is similar to meta-analytic estimates. Multiple analyses suggested that a broad cognitive deficit characterizes this sample. These deficits are modestly related to negative symptoms and essentially independent of positive symptom severity.

The MATRICS Consensus Cognitive Battery, Part 2: Co-Norming and Standardization

OBJECTIVE The consensus cognitive battery developed by the National Institute of Mental Healths (NIMHs) Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative includes 10 independently developed tests that are recommended as the standard battery for clinical trials of cognition-enhancing interventions for schizophrenia. To facilitate interpretation of results from the MATRICS Consensus Cognitive Battery using a common scaling across tests, normative data were obtained from a single representative U.S. community sample with the battery administered as a unit. METHOD The MATRICS Consensus Cognitive Battery was administered to 300 individuals from the general community at five sites in differing geographic regions. For each site, recruitment was stratified by age, gender, and education. A scientific survey sampling method was used to help avoid sampling bias. The battery was administered in a standard order to each participant in a single session lasting approximately 60 minutes. Descriptive data were generated, and age, gender, and education effects on performance were examined. RESULTS Prominent age and education effects were observed across tests. The results for gender differed by measure, suggesting the need for age and gender corrections in clinical trials. The MATRICS Consensus Cognitive Battery components were co-normed, with allowance for demographic corrections. CONCLUSIONS Co-norming a battery such as the MATRICS Consensus Cognitive Battery, comprising tests from independent test developers each with their own set of norms, facilitates valid interpretation of test scores and communication of findings across studies. These normative data will aid in estimating the magnitude of change during clinical trials of cognition-enhancing agents and make it possible to derive more directly interpretable composite scores.

Reward Processing in Schizophrenia: A Deficit in the Representation of Value

Patients with schizophrenia demonstrate deficits in motivation and learning that suggest impairment in different aspects of the reward system. In this article, we present the results of 8 converging experiments that address subjective reward experience, the impact of rewards on decision making, and the role of rewards in guiding both rapid and long-term learning. All experiments compared the performance of stably treated outpatients with schizophrenia and demographically matched healthy volunteers. Results to date suggest (1) that patients have surprisingly normal experiences of positive emotion when presented with evocative stimuli, (2) that patients show reduced correlation, compared with controls, between their own subjective valuation of stimuli and action selection, (3) that decision making in patients appears to be compromised by deficits in the ability to fully represent the value of different choices and response options, and (4) that rapid learning on the basis of trial-to-trial feedback is severely impaired whereas more gradual learning may be surprisingly preserved in many paradigms. The overall pattern of findings suggests compromises in the orbital and dorsal prefrontal structures that play a critical role in the ability to represent the value of outcomes and plans. In contrast, patients often (but not always) approach normal performance levels on the slow learning achieved by the integration of reinforcement signals over many trials, thought to be mediated by the basal ganglia.

Cognitive deficits as treatment targets in schizophrenia

Cognitive impairment has emerged as an important new target in schizophrenia therapeutics in light of evidence that cognitive deficits are critically related to the functional of disability that is characteristic of the illness. Evidence is briefly reviewed supporting the idea that the cognitive impairment in schizophrenia is an attractive target for therapeutic intervention including: (1) there is a characteristic pattern of cognitive deficits that occur with very high frequency; (2) the deficits are relatively stable over time; and (3) cognitive deficits are relatively independent of the symptomatic manifestations of the illness. Thus, cognitive impairment appears to be a well-defined, reliable and distinct dimension of the illness.

Forms of memory failure in schizophrenia.

Effortful and automatic memory task performances were examined in 36 schizophrenic patients and 18 normal control Ss. Tasks included free recall, recognition, and frequency estimation. Patients demonstrated impairment in recall, in recognition, in semantic encoding, and in frequency estimation. Deficits were observed across tasks despite differences in attentional demands. The results suggest a basic compromise of memory function, which is consistent with recent neuroimaging evidence of structural or physiological abnormalities in frontal and temporal lobe structures in schizophrenia.