Michael L. Thomas

The Value of Item Response Theory in Clinical Assessment: A Review

Item response theory (IRT) and related latent variable models represent modern psychometric theory, the successor to classical test theory in psychological assessment. Although IRT has become prevalent in the measurement of ability and achievement, its contributions to clinical domains have been less extensive. Applications of IRT to clinical assessment are reviewed to appraise its current and potential value. Benefits of IRT include comprehensive analyses and reduction of measurement error, creation of computer adaptive tests, meaningful scaling of latent variables, objective calibration and equating, evaluation of test and item bias, greater accuracy in the assessment of change due to therapeutic intervention, and evaluation of model and person fit. The theory may soon reinvent the manner in which tests are selected, developed, and scored. Although challenges remain to the widespread implementation of IRT, its application to clinical assessment holds great promise. Recommendations for research, test development, and clinical practice are provided.

Minimization of childhood maltreatment is common and consequential: results from a large, multinational sample using the childhood trauma questionnaire

Childhood maltreatment has diverse, lifelong impact on morbidity and mortality. The Childhood Trauma Questionnaire (CTQ) is one of the most commonly used scales to assess and quantify these experiences and their impact. Curiously, despite very widespread use of the CTQ, scores on its Minimization-Denial (MD) subscale—originally designed to assess a positive response bias—are rarely reported. Hence, little is known about this measure. If response biases are either common or consequential, current practices of ignoring the MD scale deserve revision. Therewith, we designed a study to investigate 3 aspects of minimization, as defined by the CTQ’s MD scale: 1) its prevalence; 2) its latent structure; and finally 3) whether minimization moderates the CTQ’s discriminative validity in terms of distinguishing between psychiatric patients and community volunteers. Archival, item-level CTQ data from 24 multinational samples were combined for a total of 19,652 participants. Analyses indicated: 1) minimization is common; 2) minimization functions as a continuous construct; and 3) high MD scores attenuate the ability of the CTQ to distinguish between psychiatric patients and community volunteers. Overall, results suggest that a minimizing response bias—as detected by the MD subscale—has a small but significant moderating effect on the CTQ’s discriminative validity. Results also may suggest that some prior analyses of maltreatment rates or the effects of early maltreatment that have used the CTQ may have underestimated its incidence and impact. We caution researchers and clinicians about the widespread practice of using the CTQ without the MD or collecting MD data but failing to assess and control for its effects on outcomes or dependent variables.

Validation of mismatch negativity and P3a for use in multi-site studies of schizophrenia: characterization of demographic, clinical, cognitive, and functional correlates in COGS-2.

Mismatch negativity (MMN) and P3a are auditory event-related potential (ERP) components that show robust deficits in schizophrenia (SZ) patients and exhibit qualities of endophenotypes, including substantial heritability, test-retest reliability, and trait-like stability. These measures also fulfill criteria for use as cognition and function-linked biomarkers in outcome studies, but have not yet been validated for use in large-scale multi-site clinical studies. This study tested the feasibility of adding MMN and P3a to the ongoing Consortium on the Genetics of Schizophrenia (COGS) study. The extent to which demographic, clinical, cognitive, and functional characteristics contribute to variability in MMN and P3a amplitudes was also examined. Participants (HCS n=824, SZ n=966) underwent testing at 5 geographically distributed COGS laboratories. Valid ERP recordings were obtained from 91% of HCS and 91% of SZ patients. Highly significant MMN (d=0.96) and P3a (d=0.93) amplitude reductions were observed in SZ patients, comparable in magnitude to those observed in single-lab studies with no appreciable differences across laboratories. Demographic characteristics accounted for 26% and 18% of the variance in MMN and P3a amplitudes, respectively. Significant relationships were observed among demographically-adjusted MMN and P3a measures and medication status as well as several clinical, cognitive, and functional characteristics of the SZ patients. This study demonstrates that MMN and P3a ERP biomarkers can be feasibly used in multi-site clinical studies. As with many clinical tests of brain function, demographic factors contribute to MMN and P3a amplitudes and should be carefully considered in future biomarker-informed clinical studies.

Genome-wide Association Studies of Posttraumatic Stress Disorder in 2 Cohorts of US Army Soldiers

IMPORTANCE Posttraumatic stress disorder (PTSD) is a prevalent, serious public health concern, particularly in the military. The identification of genetic risk factors for PTSD may provide important insights into the biological foundation of vulnerability and comorbidity. OBJECTIVE To discover genetic loci associated with the lifetime risk for PTSD in 2 cohorts from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). DESIGN, SETTING, AND PARTICIPANTS Two coordinated genome-wide association studies of mental health in the US military contributed participants. The New Soldier Study (NSS) included 3167 unique participants with PTSD and 4607 trauma-exposed control individuals; the Pre/Post Deployment Study (PPDS) included 947 unique participants with PTSD and 4969 trauma-exposed controls. The NSS data were collected from February 1, 2011, to November 30, 2012; the PDDS data, from January 9 to April 30, 2012. The primary analysis compared lifetime DSM-IV PTSD cases with trauma-exposed controls without lifetime PTSD. Data were analyzed from March 18 to December 27, 2015. MAIN OUTCOMES AND MEASURES Association analyses for PTSD used logistic regression models within each of 3 ancestral groups (European, African, and Latino American) by study, followed by meta-analysis. Heritability and genetic correlation and pleiotropy with other psychiatric and immune-related disorders were estimated. RESULTS The NSS population was 80.7% male (6277 of 7774 participants; mean [SD] age, 20.9 [3.3] years); the PPDS population, 94.4% male (5583 of 5916 participants; mean [SD] age, 26.5 [6.0] years). A genome-wide significant locus was found in ANKRD55 on chromosome 5 (rs159572; odds ratio [OR], 1.62; 95% CI, 1.37-1.92; P = 2.34 × 10-8) and persisted after adjustment for cumulative trauma exposure (adjusted OR, 1.64; 95% CI, 1.39-1.95; P = 1.18 × 10-8) in the African American samples from the NSS. A genome-wide significant locus was also found in or near ZNF626 on chromosome 19 (rs11085374; OR, 0.77; 95% CI, 0.70-0.85; P = 4.59 × 10-8) in the European American samples from the NSS. Similar results were not found for either single-nucleotide polymorphism in the corresponding ancestry group from the PPDS sample, in other ancestral groups, or in transancestral meta-analyses. Single-nucleotide polymorphism-based heritability was nonsignificant, and no significant genetic correlations were observed between PTSD and 6 mental disorders or 9 immune-related disorders. Significant evidence of pleiotropy was observed between PTSD and rheumatoid arthritis and, to a lesser extent, psoriasis. CONCLUSIONS AND RELEVANCE In the largest genome-wide association study of PTSD to date, involving a US military sample, limited evidence of association for specific loci was found. Further efforts are needed to replicate the genome-wide significant association with ANKRD55-associated in prior research with several autoimmune and inflammatory disorders-and to clarify the nature of the genetic overlap observed between PTSD and rheumatoid arthritis and psoriasis.

Independent Validation of the MMPI-2-RF Somatic/Cognitive and Validity Scales in TBI Litigants Tested for Effort

The MMPI-2 Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008) is replacing the MMPI-2 as the most widely used personality test in neuropsychological assessment, but additional validation studies are needed. Our study examines MMPI-2-RF Validity scales and the newly created Somatic/Cognitive scales in a recently reported sample of 82 traumatic brain injury (TBI) litigants who either passed or failed effort tests (Thomas & Youngjohn, 2009). The restructured Validity scales FBS-r (restructured symptom validity), F-r (restructured infrequent responses), and the newly created Fs (infrequent somatic responses) were not significant predictors of TBI severity. FBS-r was significantly related to passing or failing effort tests, and Fs and F-r showed non-significant trends in the same direction. Elevations on the Somatic/Cognitive scales profile (MLS-malaise, GIC-gastrointestinal complaints, HPC-head pain complaints, NUC-neurological complaints, and COG-cognitive complaints) were significant predictors of effort test failure. Additionally, HPC had the anticipated paradoxical inverse relationship with head injury severity. The Somatic/Cognitive scales as a group were better predictors of effort test failure than the RF Validity scales, which was an unexpected finding. MLS arose as the single best predictor of effort test failure of all RF Validity and Somatic/Cognitive scales. Item overlap analysis revealed that all MLS items are included in the original MMPI-2 Hy scale, making MLS essentially a subscale of Hy. This study validates the MMPI-2-RF as an effective tool for use in neuropsychological assessment of TBI litigants.

Let's Not Get Hysterical: Comparing the MMPI-2 Validity, Clinical, and RC Scales in TBI Litigants Tested for Effort

The MMPI-2 restructured clinical (RC) scales replace the traditional clinical scales in the MMPI-2 restructured form (MMPI-2-RF). Few studies to date have examined the MMPI-2 RC scales in traumatic brain injury (TBI) litigants. We compared MMPI-2 validity, clinical, and RC scales profiles of 83 mild, complicated mild, and moderate/severe TBI litigants who were tested for effort. Past research shows that patients referred for neuropsychological evaluations with mild TBIs paradoxically have higher MMPI-2 clinical scale elevations than patients with moderate/severe TBIs. Failure on cognitive symptom validity tests (SVTs) has also been associated with elevated validity and clinical scales profiles. The “conversion V” (elevated Hs and Hy, followed by D) is the most frequent elevated profile configuration in mild TBI and/or SVT failure. We sought to determine if these patterns of symptom reporting would replicate on the RC scales profile. Archival data from independent neuropsychological examinations were used to correlate TBI severity, cognitive test effort as indicated by SVTs, and MMPI-2 profiles. Results suggest that the validity, clinical, and RC scales profiles all correlate well with indices of cognitive test effort (namely that failure on SVTs is correlated with elevated symptom reporting). In addition, the validity scales profile, but not the clinical or RC scales profiles, was significantly inversely related to TBI severity. Discriminant function analyses suggest that the MMPI-2 RC scales can aid in the diagnosis of over-reported TBI symptomatology. However, RC3—the RC equivalent of the Hy scale—no longer appears to serve as a marker of somatization and/or malingering.

Prospective Longitudinal Evaluation of the Effect of Deployment-Acquired Traumatic Brain Injury on Posttraumatic Stress and Related Disorders: Results From the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS)

OBJECTIVE Traumatic brain injury (TBI) is increasingly recognized as a risk factor for deleterious mental health and functional outcomes. The purpose of this study was to examine the strength and specificity of the association between deployment-acquired TBI and subsequent posttraumatic stress and related disorders among U.S. Army personnel. METHOD A prospective, longitudinal survey of soldiers in three Brigade Combat Teams was conducted 1-2 months prior to an average 10-month deployment to Afghanistan (T0), upon redeployment to the United States (T1), approximately 3 months later (T2), and approximately 9 months later (T3). Outcomes of interest were 30-day prevalence postdeployment of posttraumatic stress disorder (PTSD), major depressive episode, generalized anxiety disorder, and suicidality, as well as presence and severity of postdeployment PTSD symptoms. RESULTS Complete information was available for 4,645 soldiers. Approximately one in five soldiers reported exposure to mild (18.0%) or more-than-mild (1.2%) TBI(s) during the index deployment. Even after adjusting for other risk factors (e.g., predeployment mental health status, severity of deployment stress, prior TBI history), deployment-acquired TBI was associated with elevated adjusted odds of PTSD and generalized anxiety disorder at T2 and T3 and of major depressive episode at T2. Suicidality risk at T2 appeared similarly elevated, but this association did not reach statistical significance. CONCLUSIONS The findings highlight the importance of surveillance efforts to identify soldiers who have sustained TBIs and are therefore at risk for an array of postdeployment adverse mental health outcomes, including but not limited to PTSD. The mechanism(s) accounting for these associations need to be elucidated to inform development of effective preventive and early intervention programs.

Modeling Deficits From Early Auditory Information Processing to Psychosocial Functioning in Schizophrenia

Importance Neurophysiologic measures of early auditory information processing (EAP) are used as endophenotypes in genomic studies and biomarkers in clinical intervention studies. Research in schizophrenia has established correlations among measures of EAP, cognition, clinical symptoms, and functional outcome. Clarifying these associations by determining the pathways through which deficits in EAP affect functioning would suggest when and where to therapeutically intervene. Objectives To characterize the pathways from EAP to outcome and to estimate the extent to which enhancement of basic information processing might improve cognition and psychosocial functioning in schizophrenia. Design, Setting, and Participants Cross-sectional data were analyzed using structural equation modeling to examine the associations among EAP, cognition, negative symptoms, and functional outcome. Participants were recruited from the community at 5 geographically distributed laboratories as part of the Consortium on the Genetics of Schizophrenia 2 from July 1, 2010, through January 31, 2014. This well-characterized cohort of 1415 patients with schizophrenia underwent EAP, cognitive, and thorough clinical and functional assessment. Main Outcome and Measures Mismatch negativity, P3a, and reorienting negativity were used to measure EAP. Cognition was measured by the Letter Number Span test and scales from the California Verbal Learning Test–Second Edition, the Wechsler Memory Scale–Third Edition, and the Penn Computerized Neurocognitive Battery. Negative symptoms were measured by the Scale for the Assessment of Negative Symptoms. Functional outcome was measured by the Role Functioning Scale. Results Participants included 1415 unrelated outpatients diagnosed with schizophrenia or schizoaffective disorder (mean [SD] age, 46 [11] years; 979 males [69.2%] and 619 white [43.7%]). Early auditory information processing had a direct effect on cognition (&bgr; = 0.37, P < .001), cognition had a direct effect on negative symptoms (&bgr; = −0.16, P < .001), and both cognition (&bgr; = 0.26, P < .001) and experiential negative symptoms (&bgr; = −0.75, P < .001) had direct effects on functional outcome. The indirect effect of EAP on functional outcome was significant as well (&bgr; = 0.14, P < .001). Overall, EAP had a fully mediated effect on functional outcome, engaging general rather than modality-specific cognition, with separate pathways that involved or bypassed negative symptoms. Conclusions and Relevance The data support a model in which EAP deficits lead to poor functional outcome via impaired cognition and increased negative symptoms. Results can be used to help guide mechanistically informed, personalized treatments and support the strategy of using EAP measures as surrogate end points in early-stage procognitive intervention studies.

The Minnesota Multiphasic Personality Inventory-2-Restructured Form in the epilepsy monitoring unit

The Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) is a restructuring of the MMPI-2 that has improved the psychometric characteristics of the test. The primary aim of this study was to provide diagnostic utility data on the MMPI-2-RF in an epilepsy monitoring unit population (N=429). Mean comparisons revealed group differences on Validity Scales Fs and FBS-r; Restructured Clinical Scales RC1 and RC3; and Somatic Scales MLS, GIC, HPC, and NUC. Diagnostic utility data are provided for those scales with the largest effect sizes: RC1, FBS-r, and NUC. On RC1, sensitivity was 76% and specificity was 60%, similar to values found when applying published decision rules to the MMPI-2. RC1 explains unique variance in diagnosis beyond that explained by demographic or medical history risk factors. We provide likelihood ratios for scores on RC1, FBS-r, and NUC that can be used by the clinician to calculate posttest odds and probability of nonepileptic seizures using the base rate of nonepileptic seizures in his/her population.

Psychometric properties of the MMPI-2-RF Somatic Complaints (RC1) Scale.

The MMPI-2 Restructured Form (MMPI-2-RF; Tellegen & Ben-Porath, 2008) was designed to be psychometrically superior to its MMPI-2 counterpart. However, the test has yet to be extensively evaluated in diverse clinical settings. The purpose of this study was to examine the psychometric properties of the MMPI-2-RF Somatic Complaints (RC1) scale in a clinically relevant population. Participants were 399 patients diagnosed with either epilepsy or psychogenic nonepileptic seizures on the basis of video-electroencephalograph monitoring. The internal structure of the MMPI-2-RF was evaluated using taxometric, confirmatory factor analysis, and item response theory procedures. Data from 4 content-specific scales directly related to RC1 (Malaise, Gastrointestinal Complaints, Head Pain Complaints, and Neurological Complaints) indicated that the latent construct of somatization is a dimensional variable with a bifactor structure. However, consistent with the scales construction, a unidimensional model also provided adequate fit. A 2-parameter logistic item response theory model better accounted for observed item responses than did 1- or 3-parameter models. Results suggest that the RC1 scale is most precise for T score estimates between 55 and 90. Overall, the scale appears to be well suited for the assessment of somatization.