Kathleen Wallner-Allen

Cognition assessment using the NIH Toolbox

Vision is a sensation that is created from complex processes and provides us with a representation of the world around us. There are many important aspects of vision, but visual acuity was judged to be the most appropriate vision assessment for the NIH Toolbox for Assessment of Neurological and Behavioral Function, both because of its central role in visual health and because acuity testing is common and relatively inexpensive to implement broadly. The impact of visual impairments on health-related quality of life also was viewed as important to assess, in order to gain a broad view of ones visual function. To test visual acuity, an easy-to-use software program was developed, based on the protocol used by the E-ETDRS. Children younger than 7 years were administered a version with only the letters H, O, T, and V. Reliability and validity of the Toolbox visual acuity test were very good. A 53-item vision-targeted, health-related quality of life survey was also developed.

II. NIH Toolbox Cognition Battery (CB): measuring executive function and attention.

In this chapter, we discuss two measures designed to assess executive function (EF) as part of the NIH Toolbox Cognition Battery (CB) and report pediatric data from the validation study. EF refers to the goal-directed cognitive control of thought, action, and emotion. Two measures were adapted for standardized computer administration: the Dimensional Change Card Sort (a measure of cognitive flexibility) and a flanker task (a measure of inhibitory control in the context of selective visual attention). Results reveal excellent developmental sensitivity across childhood, excellent reliability, and (in most cases) excellent convergent validity. Correlations between the new NIH Toolbox measures and age were higher for younger children (3-6 years) than for older children (8-15 years), and evidence of increasing differentiation of EF from other aspects of cognition (indexed by receptive vocabulary) was obtained.

The Cognition Battery of the NIH Toolbox for Assessment of Neurological and Behavioral Function: Validation in an Adult Sample

This study introduces a special series on validity studies of the Cognition Battery (CB) from the U.S. National Institutes of Health Toolbox for the Assessment of Neurological and Behavioral Function (NIHTB) (Gershon, Wagster et al., 2013) in an adult sample. This first study in the series describes the sample, each of the seven instruments in the NIHTB-CB briefly, and the general approach to data analysis. Data are provided on test-retest reliability and practice effects, and raw scores (mean, standard deviation, range) are presented for each instrument and the gold standard instruments used to measure construct validity. Accompanying papers provide details on each instrument, including information about instrument development, psychometric properties, age and education effects on performance, and convergent and discriminant construct validity. One study in the series is devoted to a factor analysis of the NIHTB-CB in adults and another describes the psychometric properties of three composite scores derived from the individual measures representing fluid and crystallized abilities and their combination. The NIHTB-CB is designed to provide a brief, comprehensive, common set of measures to allow comparisons among disparate studies and to improve scientific communication.

NIH Toolbox Cognition Battery (CB): Validation of Executive Function Measures in Adults

This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) executive function measures in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20-85 years), gender, education and ethnicity. The NIHTB-CB contains two computer-based instruments assessing executive function: the Dimensional Change Card Sort (a measure of cognitive flexibility) and a flanker task (a measure of inhibitory control and selective attention). Participants completed the NIHTB-CB, corresponding gold standard convergent and discriminant measures, and sociodemographic questionnaires. A subset of participants (N=89) was retested 7 to 21 days later. Results reveal excellent sensitivity to age-related changes during adulthood, excellent test-retest reliability, and adequate to good convergent and discriminant validity. The NIH Toolbox EF measures can be used effectively in epidemiologic and clinical studies.

NIH toolbox cognition battery (CB): Introduction and pediatric data

This monograph presents the pediatric portion of the National Institutes of Health (NIH) Toolbox Cognition Battery (CB) of the NIH Toolbox for the Assessment of Neurological and Behavioral Function. The NIH Toolbox is an initiative of the Neuroscience Blueprint, a collaborative framework through which 16 NIH Institutes, Centers, and Offices jointly support neuroscience-related research, to accelerate discoveries and reduce the burden of nervous system disorders. The CB is one of four modules that measure cognitive, emotional, sensory, and motor health across the lifespan. The CB is unique in its continuity across childhood, adolescence, early adulthood, and old age, and in order to help create a common currency among disparate studies, it is also available at low cost to researchers for use in large-scale longitudinal and epidemiologic studies. This chapter describes the evolution of the CB; methods for selecting cognitive subdomains and instruments; the rationale for test design; and a validation study in children and adolescents, ages 3-15 years. Subsequent chapters feature detailed discussions of each test measure and its psychometric properties (Chapters 2-6), the factor structure of the test battery (Chapter 7), the effects of age and education on composite test scores (Chapter 8), and a final summary and discussion (Chapter 9). As the chapters in this monograph demonstrate, the CB has excellent psychometric properties, and the validation study provided evidence for the increasing differentiation of cognitive abilities with age.

IV. NIH Toolbox Cognition Battery (CB): measuring language (vocabulary comprehension and reading decoding).

Mastery of language skills is an important predictor of daily functioning and health. Vocabulary comprehension and reading decoding are relatively quick and easy to measure and correlate highly with overall cognitive functioning, as well as with success in school and work. New measures of vocabulary comprehension and reading decoding (in both English and Spanish) were developed for the NIH Toolbox Cognition Battery (CB). In the Toolbox Picture Vocabulary Test (TPVT), participants hear a spoken word while viewing four pictures, and then must choose the picture that best represents the word. This approach tests receptive vocabulary knowledge without the need to read or write, removing the literacy load for children who are developing literacy and for adults who struggle with reading and writing. In the Toolbox Oral Reading Recognition Test (TORRT), participants see a letter or word onscreen and must pronounce or identify it. The examiner determines whether it was pronounced correctly by comparing the response to the pronunciation guide on a separate computer screen. In this chapter, we discuss the importance of language during childhood and the relation of language and brain function. We also review the development of the TPVT and TORRT, including information about the item calibration process and results from a validation study. Finally, the strengths and weaknesses of the measures are discussed.

Using the NIH Toolbox in special populations Considerations for assessment of pediatric, geriatric, culturally diverse, non–English-speaking, and disabled individuals

Background: In order to develop health outcomes measures that are relevant and applicable to the general population, it is essential to consider the needs and requirements of special subgroups, such as the young, elderly, disabled, and people of different ethnic and cultural backgrounds, within that population. Methods: The NIH Toolbox project convened several working groups to address assessment issues for the following subgroups: pediatric, geriatric, cultural, non–English-speaking, and disabled. Each group reviewed all NIH Toolbox instruments in their entirety. Results: Each working group provided recommendations to the scientific study teams regarding instrument content, presentation, and administration. When feasible and appropriate, instruments and administration procedures have been modified in accordance with these recommendations. Conclusion: Health outcome measurement can benefit from expert input regarding assessment considerations for special subgroups.

I. NIH TOOLBOX COGNITION BATTERY (CB): INTRODUCTION AND PEDIATRIC DATA: NIH TOOLBOX COGNITION BATTERY (CB)

This monograph presents the pediatric portion of the National Institutes of Health (NIH) Toolbox Cognition Battery (CB) of the NIH Toolbox for the Assessment of Neurological and Behavioral Function. The NIH Toolbox is an initiative of the Neuroscience Blueprint, a collaborative framework through which 16 NIH Institutes, Centers, and Offices jointly support neuroscience-related research, to accelerate discoveries and reduce the burden of nervous system disorders. The CB is one of four modules that measure cognitive, emotional, sensory, and motor health across the lifespan. The CB is unique in its continuity across childhood, adolescence, early adulthood, and old age, and in order to help create a common currency among disparate studies, it is also available at low cost to researchers for use in large-scale longitudinal and epidemiologic studies. This chapter describes the evolution of the CB; methods for selecting cognitive subdomains and instruments; the rationale for test design; and a validation study in children and adolescents, ages 3-15 years. Subsequent chapters feature detailed discussions of each test measure and its psychometric properties (Chapters 2-6), the factor structure of the test battery (Chapter 7), the effects of age and education on composite test scores (Chapter 8), and a final summary and discussion (Chapter 9). As the chapters in this monograph demonstrate, the CB has excellent psychometric properties, and the validation study provided evidence for the increasing differentiation of cognitive abilities with age.

NIH toolbox cognition battery (CB)

This monograph presents the pediatric portion of the National Institutes of Health (NIH) Toolbox Cognition Battery (CB) of the NIH Toolbox for the Assessment of Neurological and Behavioral Function. The NIH Toolbox is an initiative of the Neuroscience Blueprint, a collaborative framework through which 16 NIH Institutes, Centers, and Offices jointly support neuroscience-related research, to accelerate discoveries and reduce the burden of nervous system disorders. The CB is one of four modules that measure cognitive, emotional, sensory, and motor health across the lifespan. The CB is unique in its continuity across childhood, adolescence, early adulthood, and old age, and in order to help create a common currency among disparate studies, it is also available at low cost to researchers for use in large-scale longitudinal and epidemiologic studies. This chapter describes the evolution of the CB; methods for selecting cognitive subdomains and instruments; the rationale for test design; and a validation study in children and adolescents, ages 3-15 years. Subsequent chapters feature detailed discussions of each test measure and its psychometric properties (Chapters 2-6), the factor structure of the test battery (Chapter 7), the effects of age and education on composite test scores (Chapter 8), and a final summary and discussion (Chapter 9). As the chapters in this monograph demonstrate, the CB has excellent psychometric properties, and the validation study provided evidence for the increasing differentiation of cognitive abilities with age.