Tyler M. Moore

Bifactor Models and Rotations: Exploring the Extent to which Multidimensional Data Yield Univocal Scale Scores

The application of psychological measures often results in item response data that arguably are consistent with both unidimensional (a single common factor) and multidimensional latent structures (typically caused by parcels of items that tap similar content domains). As such, structural ambiguity leads to seemingly endless “confirmatory” factor analytic studies in which the research question is whether scale scores can be interpreted as reflecting variation on a single trait. An alternative to the more commonly observed unidimensional, correlated traits, or second-order representations of a measures latent structure is a bifactor model. Bifactor structures, however, are not well understood in the personality assessment community and thus rarely are applied. To address this, herein we (a) describe issues that arise in conceptualizing and modeling multidimensionality, (b) describe exploratory (including Schmid–Leiman [Schmid & Leiman, 1957] and target bifactor rotations) and confirmatory bifactor modeling, (c) differentiate between bifactor and second-order models, and (d) suggest contexts where bifactor analysis is particularly valuable (e.g., for evaluating the plausibility of subscales, determining the extent to which scores reflect a single variable even when the data are multidimensional, and evaluating the feasibility of applying a unidimensional item response theory (IRT) measurement model). We emphasize that the determination of dimensionality is a related but distinct question from either determining the extent to which scores reflect a single individual difference variable or determining the effect of multidimensionality on IRT item parameter estimates. Indeed, we suggest that in many contexts, multidimensional data can yield interpretable scale scores and be appropriately fitted to unidimensional IRT models.

The psychosis spectrum in a young U.S. community sample: findings from the Philadelphia Neurodevelopmental Cohort

Little is known about the occurrence and predictors of the psychosis spectrum in large non‐clinical community samples of U.S. youths. We aimed to bridge this gap through assessment of psychosis spectrum symptoms in the Philadelphia Neurodevelopmental Cohort, a collaborative investigation of clinical and neurobehavioral phenotypes in a prospectively accrued cohort of youths, funded by the National Institute of Mental Health. Youths (age 11‐21; N=7,054) and collateral informants (caregiver/legal guardian) were recruited through the Childrens Hospital of Philadelphia and administered structured screens of psychosis spectrum symptoms, other major psychopathology domains, and substance use. Youths were also administered a computerized neurocognitive battery assessing five neurobehavioral domains. Predictors of psychosis spectrum status in physically healthy participants (N=4,848) were examined using logistic regression. Among medically healthy youths, 3.7% reported threshold psychotic symptoms (delusions and/or hallucinations). An additional 12.3% reported significant sub‐psychotic positive symptoms, with odd/unusual thoughts and auditory perceptions, followed by reality confusion, being the most discriminating and widely endorsed attenuated symptoms. A minority of youths (2.3%) endorsed subclinical negative/disorganized symptoms in the absence of positive symptoms. Caregivers reported lower symptom levels than their children. Male gender, younger age, and non‐European American ethnicity were significant predictors of spectrum status. Youths with spectrum symptoms had reduced accuracy across neurocognitive domains, reduced global functioning, and increased odds of depression, anxiety, behavioral disorders, substance use and suicidal ideation. These findings have public health relevance for prevention and early intervention.

The Barratt Impulsiveness Scale - 11: Reassessment of its Structure in a Community Sample

The Barratt Impulsiveness Scale (Version 11; BIS-11; Patton, Stanford, & Barratt, 1995) is a gold-standard measure that has been influential in shaping current theories of impulse control, and has played a key role in studies of impulsivity and its biological, psychological, and behavioral correlates. Psychometric research on the structure of the BIS-11, however, has been scant. We therefore applied exploratory and confirmatory factor analyses to data collected using the BIS-11 in a community sample (N = 691). Our goal was to test 4 theories of the BIS-11 structure: (a) a unidimensional model, (b) a 6 correlated first-order factor model, (c) a 3 second-order factor model, and (d) a bifactor model. Among the problems identified were (a) low or near-zero correlations of some items with others; (b) highly redundant content of numerous item pairs; (c) items with salient cross-loadings in multidimensional solutions; and, ultimately, (d) poor fit to confirmatory models. We conclude that use of the BIS-11 total score as reflecting individual differences on a common dimension of impulsivity presents challenges in interpretation. Also, the theory that the BIS-11 measures 3 subdomains of impulsivity (attention, motor, and nonplanning) was not empirically supported. A 2-factor model is offered as an alternative multidimensional structural representation.

The impact of quality assurance assessment on diffusion tensor imaging outcomes in a large-scale population-based cohort.

BACKGROUND Diffusion tensor imaging (DTI) is applied in investigation of brain biomarkers for neurodevelopmental and neurodegenerative disorders. However, the quality of DTI measurements, like other neuroimaging techniques, is susceptible to several confounding factors (e.g., motion, eddy currents), which have only recently come under scrutiny. These confounds are especially relevant in adolescent samples where data quality may be compromised in ways that confound interpretation of maturation parameters. The current study aims to leverage DTI data from the Philadelphia Neurodevelopmental Cohort (PNC), a sample of 1601 youths with ages of 8-21 who underwent neuroimaging, to: 1) establish quality assurance (QA) metrics for the automatic identification of poor DTI image quality; 2) examine the performance of these QA measures in an external validation sample; 3) document the influence of data quality on developmental patterns of typical DTI metrics. METHODS All diffusion-weighted images were acquired on the same scanner. Visual QA was performed on all subjects completing DTI; images were manually categorized as Poor, Good, or Excellent. Four image quality metrics were automatically computed and used to predict manual QA status: Mean voxel intensity outlier count (MEANVOX), Maximum voxel intensity outlier count (MAXVOX), mean relative motion (MOTION) and temporal signal-to-noise ratio (TSNR). Classification accuracy for each metric was calculated as the area under the receiver-operating characteristic curve (AUC). A threshold was generated for each measure that best differentiated visual QA status and applied in a validation sample. The effects of data quality on sensitivity to expected age effects in this developmental sample were then investigated using the traditional MRI diffusion metrics: fractional anisotropy (FA) and mean diffusivity (MD). Finally, our method of QA is compared with DTIPrep. RESULTS TSNR (AUC=0.94) best differentiated Poor data from Good and Excellent data. MAXVOX (AUC=0.88) best differentiated Good from Excellent DTI data. At the optimal threshold, 88% of Poor data and 91% Good/Excellent data were correctly identified. Use of these thresholds on a validation dataset (n=374) indicated high accuracy. In the validation sample 83% of Poor data and 94% of Excellent data was identified using thresholds derived from the training sample. Both FA and MD were affected by the inclusion of poor data in an analysis of an age, sex and race matched comparison sample. In addition, we show that the inclusion of poor data results in significant attenuation of the correlation between diffusion metrics (FA and MD) and age during a critical neurodevelopmental period. We find higher correspondence between our QA method and DTIPrep for Poor data, but we find our method to be more robust for apparently high-quality images. CONCLUSION Automated QA of DTI can facilitate large-scale, high-throughput quality assurance by reliably identifying both scanner and subject induced imaging artifacts. The results present a practical example of the confounding effects of artifacts on DTI analysis in a large population-based sample, and suggest that estimates of data quality should not only be reported but also accounted for in data analysis, especially in studies of development.

Association of DNA Methylation Differences With Schizophrenia in an Epigenome-Wide Association Study

IMPORTANCE DNA methylation may play an important role in schizophrenia (SZ), either directly as a mechanism of pathogenesis or as a biomarker of risk. OBJECTIVE To scan genome-wide DNA methylation data to identify differentially methylated CpGs between SZ cases and controls. DESIGN, SETTING, AND PARTICIPANTS Epigenome-wide association study begun in 2008 using DNA methylation levels of 456 513 CpG loci measured on the Infinium HumanMethylation450 array (Illumina) in a consortium of case-control studies for initial discovery and in an independent replication set. Primary analyses used general linear regression, adjusting for age, sex, race/ethnicity, smoking, batch, and cell type heterogeneity. The discovery set contained 689 SZ cases and 645 controls (n = 1334), from 3 multisite consortia: the Consortium on the Genetics of Endophenotypes in Schizophrenia, the Project among African-Americans To Explore Risks for Schizophrenia, and the Multiplex Multigenerational Family Study of Schizophrenia. The replication set contained 247 SZ cases and 250 controls (n = 497) from the Genomic Psychiatry Cohort. MAIN OUTCOMES AND MEASURES Identification of differentially methylated positions across the genome in SZ cases compared with controls. RESULTS Of the 689 case participants in the discovery set, 477 (69%) were men and 258 (37%) were non-African American; of the 645 controls, 273 (42%) were men and 419 (65%) were non-African American. In our replication set, cases/controls were 76% male and 100% non-African American. We identified SZ-associated methylation differences at 923 CpGs in the discovery set (false discovery rate, <0.2). Of these, 625 showed changes in the same direction including 172 with P < .05 in the replication set. Some replicated differentially methylated positions are located in a top-ranked SZ region from genome-wide association study analyses. CONCLUSIONS AND RELEVANCE This analysis identified 172 replicated new associations with SZ after careful correction for cell type heterogeneity and other potential confounders. The overlap with previous genome-wide association study data can provide potential insights into the functional relevance of genetic signals for SZ.

Target Rotations and Assessing the Impact of Model Violations on the Parameters of Unidimensional Item Response Theory Models

Reise, Cook, and Moore proposed a “comparison modeling” approach to assess the distortion in item parameter estimates when a unidimensional item response theory (IRT) model is imposed on multidimensional data. Central to their approach is the comparison of item slope parameter estimates from a unidimensional IRT model (a restricted model), with the item slope parameter estimates from the general factor in an exploratory bifactor IRT model (the unrestricted comparison model). In turn, these authors suggested that the unrestricted comparison bifactor model be derived from a target factor rotation. The goal of this study was to provide further empirical support for the use of target rotations as a method for deriving a comparison model. Specifically, we conducted Monte Carlo analyses exploring (a) the use of the Schmid–Leiman orthogonalization to specify a viable initial target matrix and (b) the recovery of true bifactor pattern matrices using target rotations as implemented in Mplus. Results suggest that to the degree that item response data conform to independent cluster structure, target rotations can be used productively to establish a plausible comparison model.

Structural Brain Abnormalities in Youth With Psychosis Spectrum Symptoms

IMPORTANCE Structural brain abnormalities are prominent in psychotic disorders, including schizophrenia. However, it is unclear when aberrations emerge in the disease process and if such deficits are present in association with less severe psychosis spectrum (PS) symptoms in youth. OBJECTIVE To investigate the presence of structural brain abnormalities in youth with PS symptoms. DESIGN, SETTING, AND PARTICIPANTS The Philadelphia Neurodevelopmental Cohort is a prospectively accrued, community-based sample of 9498 youth who received a structured psychiatric evaluation. A subsample of 1601 individuals underwent neuroimaging, including structural magnetic resonance imaging, at an academic and childrens hospital health care network between November 1, 2009, and November 30, 2011. MAIN OUTCOMES AND MEASURES Measures of brain volume derived from T1-weighted structural neuroimaging at 3 T. Analyses were conducted at global, regional, and voxelwise levels. Regional volumes were estimated with an advanced multiatlas regional segmentation procedure, and voxelwise volumetric analyses were conducted as well. Nonlinear developmental patterns were examined using penalized splines within a general additive model. Psychosis spectrum (PS) symptom severity was summarized using factor analysis and evaluated dimensionally. RESULTS Following exclusions due to comorbidity and image quality assurance, the final sample included 791 participants aged youth 8 to 22 years. Fifty percent (n = 393) were female. After structured interviews, 391 participants were identified as having PS features (PS group) and 400 participants were identified as typically developing comparison individuals without significant psychopathology (TD group). Compared with the TD group, the PS group had diminished whole-brain gray matter volume (P = 1.8 × 10-10) and expanded white matter volume (P = 2.8 × 10-11). Voxelwise analyses revealed significantly lower gray matter volume in the medial temporal lobe (maximum z score = 5.2 and cluster size of 1225 for the right and maximum z score = 4.5 and cluster size of 310 for the left) as well as in frontal, temporal, and parietal cortex. Volumetric reduction in the medial temporal lobe was correlated with PS symptom severity. CONCLUSIONS AND RELEVANCE Structural brain abnormalities that have been commonly reported in adults with psychosis are present early in life in youth with PS symptoms and are not due to medication effects. Future longitudinal studies could use the presence of such abnormalities in conjunction with clinical presentation, cognitive profile, and genomics to predict risk and aid in stratification to guide early interventions.

Common and Dissociable Mechanisms of Executive System Dysfunction Across Psychiatric Disorders in Youth.

OBJECTIVE Disruption of executive function is present in many neuropsychiatric disorders. However, determining the specificity of executive dysfunction across these disorders is challenging given high comorbidity of conditions. Here the authors investigate executive system deficits in association with dimensions of psychiatric symptoms in youth using a working memory paradigm. The authors hypothesize that common and dissociable patterns of dysfunction would be present. METHOD The authors studied 1,129 youths who completed a fractal n-back task during functional magnetic resonance imaging at 3-T as part of the Philadelphia Neurodevelopmental Cohort. Factor scores of clinical psychopathology were calculated using an item-wise confirmatory bifactor model, describing overall psychopathology as well as four orthogonal dimensions of symptoms: anxious-misery (mood and anxiety), behavioral disturbance (attention deficit hyperactivity disorder and conduct disorder), psychosis-spectrum symptoms, and fear (phobias). The effect of psychopathology dimensions on behavioral performance and executive system recruitment (2-back > 0-back) was examined using both multivariate (matrix regression) and mass-univariate (linear regression) analyses. RESULTS Overall psychopathology was associated with both abnormal multivariate patterns of activation and a failure to activate executive regions within the cingulo-opercular control network, including the frontal pole, cingulate cortex, and anterior insula. In addition, psychosis-spectrum symptoms were associated with hypoactivation of the left dorsolateral prefrontal cortex, whereas behavioral symptoms were associated with hypoactivation of the frontoparietal cortex and cerebellum. In contrast, anxious-misery symptoms were associated with widespread hyperactivation of the executive network. CONCLUSIONS These findings provide novel evidence that common and dissociable deficits within the brains executive system are present in association with dimensions of psychopathology in youth.

Diminished effort on a progressive ratio task in both unipolar and bipolar depression

BACKGROUND Amotivation, or decisional anhedonia, is a prominent and disabling feature of depression. However, this aspect of depression remains understudied, and no prior work has applied objective laboratory tests of motivation in both unipolar and bipolar depression. METHODS We assessed motivation deficits using a Progressive Ratio Task (PRT) that indexes willingness to exert effort for monetary reward. The PRT was administered to 96 adults ages 18-60 including 25 participants with a current episode of unipolar depression, 28 with bipolar disorder (current episode depressed), and 43 controls without any Axis I psychiatric disorders. RESULTS Depressed participants exhibited significantly lower motivation than control participants as objectively defined by progressive ratio breakpoints. Both the unipolar and bipolar groups were lower than controls but did not differ from each other. LIMITATIONS Medication use differed across groups, and we did not have a separate control task to measure psychomotor activity; however neither medication effects or psychomotor slowing are likely to explain our findings. CONCLUSIONS Our study fills an important gap in the literature by providing evidence that diminished effort on the PRT is present across depressed patients who experience either unipolar or bipolar depression. This adds to growing evidence for shared mechanisms of reward and motivation dysfunction, and highlights the importance of improving the assessment and treatment of motivation deficits across the mood disorders spectrum.

Developmental increases in white matter network controllability support a growing diversity of brain dynamics

Evelyn Tang, Chad Giusti, Graham Baum, Shi Gu, Ari E. Kahn, David Roalf, Tyler M. Moore, Kosha Ruparel, Ruben C. Gur, Raquel E. Gur, Theodore D. Satterthwaite, 3 and Danielle S. Bassett 4, 3 Department of Bioengineering, University of Pennsylvania, PA 19104 Brain Behavior Laboratory, Department of Psychiatry, University of Pennsylvania, PA 19104 These authors contributed equally. Department of Electrical and Systems Engineering, University of Pennsylvania, PA 19104 (Dated: May, 2016)As the human brain develops, it increasingly supports coordinated control of neural activity. The mechanism by which white matter evolves to support this coordination is not well understood. Here we use a network representation of diffusion imaging data from 882 youth ages 8–22 to show that white matter connectivity becomes increasingly optimized for a diverse range of predicted dynamics in development. Notably, stable controllers in subcortical areas are negatively related to cognitive performance. Investigating structural mechanisms supporting these changes, we simulate network evolution with a set of growth rules. We find that all brain networks are structured in a manner highly optimized for network control, with distinct control mechanisms predicted in child vs. older youth. We demonstrate that our results cannot be explained by changes in network modularity. This work reveals a possible mechanism of human brain development that preferentially optimizes dynamic network control over static network architecture.Human brain development is characterized by an increased control of neural activity, but how this happens is not well understood. Here, authors show that white matter connectivity in 882 youth, aged 8-22, becomes increasingly specialized locally and is optimized for network control.