Qingbao Yu

A review of multivariate methods for multimodal fusion of brain imaging data

The development of various neuroimaging techniques is rapidly improving the measurements of brain function/structure. However, despite improvements in individual modalities, it is becoming increasingly clear that the most effective research approaches will utilize multi-modal fusion, which takes advantage of the fact that each modality provides a limited view of the brain. The goal of multi-modal fusion is to capitalize on the strength of each modality in a joint analysis, rather than a separate analysis of each. This is a more complicated endeavor that must be approached more carefully and efficient methods should be developed to draw generalized and valid conclusions from high dimensional data with a limited number of subjects. Numerous research efforts have been reported in the field based on various statistical approaches, e.g. independent component analysis (ICA), canonical correlation analysis (CCA) and partial least squares (PLS). In this review paper, we survey a number of multivariate methods appearing in previous multimodal fusion reports, mostly fMRI with other modality, which were performed with or without prior information. A table for comparing optimization assumptions, purpose of the analysis, the need of priors, dimension reduction strategies and input data types is provided, which may serve as a valuable reference that helps readers understand the trade-offs of the 7 methods comprehensively. Finally, we evaluate 3 representative methods via simulation and give some suggestions on how to select an appropriate method based on a given research.

Altered Topological Properties of Functional Network Connectivity in Schizophrenia during Resting State: A Small-World Brain Network Study

Aberrant topological properties of small-world human brain networks in patients with schizophrenia (SZ) have been documented in previous neuroimaging studies. Aberrant functional network connectivity (FNC, temporal relationships among independent component time courses) has also been found in SZ by a previous resting state functional magnetic resonance imaging (fMRI) study. However, no study has yet determined if topological properties of FNC are also altered in SZ. In this study, small-world network metrics of FNC during the resting state were examined in both healthy controls (HCs) and SZ subjects. FMRI data were obtained from 19 HCs and 19 SZ. Brain images were decomposed into independent components (ICs) by group independent component analysis (ICA). FNC maps were constructed via a partial correlation analysis of ICA time courses. A set of undirected graphs were built by thresholding the FNC maps and the small-world network metrics of these maps were evaluated. Our results demonstrated significantly altered topological properties of FNC in SZ relative to controls. In addition, topological measures of many ICs involving frontal, parietal, occipital and cerebellar areas were altered in SZ relative to controls. Specifically, topological measures of whole network and specific components in SZ were correlated with scores on the negative symptom scale of the Positive and Negative Symptom Scale (PANSS). These findings suggest that aberrant architecture of small-world brain topology in SZ consists of ICA temporally coherent brain networks.

Assessing dynamic brain graphs of time-varying connectivity in fMRI data: application to healthy controls and patients with schizophrenia

Graph theory-based analysis has been widely employed in brain imaging studies, and altered topological properties of brain connectivity have emerged as important features of mental diseases such as schizophrenia. However, most previous studies have focused on graph metrics of stationary brain graphs, ignoring that brain connectivity exhibits fluctuations over time. Here we develop a new framework for accessing dynamic graph properties of time-varying functional brain connectivity in resting-state fMRI data and apply it to healthy controls (HCs) and patients with schizophrenia (SZs). Specifically, nodes of brain graphs are defined by intrinsic connectivity networks (ICNs) identified by group independent component analysis (ICA). Dynamic graph metrics of the time-varying brain connectivity estimated by the correlation of sliding time-windowed ICA time courses of ICNs are calculated. First- and second-level connectivity states are detected based on the correlation of nodal connectivity strength between time-varying brain graphs. Our results indicate that SZs show decreased variance in the dynamic graph metrics. Consistent with prior stationary functional brain connectivity works, graph measures of identified first-level connectivity states show lower values in SZs. In addition, more first-level connectivity states are disassociated with the second-level connectivity state which resembles the stationary connectivity pattern computed by the entire scan. Collectively, the findings provide new evidence about altered dynamic brain graphs in schizophrenia, which may underscore the abnormal brain performance in this mental illness.

Brain connectivity networks in schizophrenia underlying resting state functional magnetic resonance imaging

Schizophrenia (SZ) is a severe neuropsychiatric disorder. A leading hypothesis is that SZ is a brain dysconnection syndrome, involving abnormal interactions between widespread brain networks. Resting state functional magnetic resonance imaging (R-fMRI) is a powerful tool to explore the dysconnectivity of brain networks in SZ and other disorders. Seed-based functional connectivity analysis, spatial independent component analysis (ICA), and graph theory-based analysis are popular methods to quantify brain network connectivity in R-fMRI data. Widespread network dysconnectivity in SZ has been observed using both seed-based analysis and ICA, although most seed-based studies report decreased connectivity while ICA studies report both increases and decreases. Importantly, most of the findings from both techniques are also associated with typical symptoms of the illness. Disrupted topological properties and altered modular community structure of brain system in SZ have been shown using graph theory-based analysis. Overall, the resting-state findings regarding brain networks deficits have advanced our understanding of the underlying pathology of SZ. In this article, we review aberrant brain connectivity networks in SZ measured in R-fMRI by the above approaches, and discuss future challenges.

Function-structure associations of the brain: Evidence from multimodal connectivity and covariance studies

Despite significant advances in multimodal imaging techniques and analysis approaches, unimodal studies are still the predominant way to investigate brain changes or group differences, including structural magnetic resonance imaging (sMRI), functional MRI (fMRI), diffusion tensor imaging (DTI) and electroencephalography (EEG). Multimodal brain studies can be used to understand the complex interplay of anatomical, functional and physiological brain alterations or development, and to better comprehend the biological significance of multiple imaging measures. To examine the function-structure associations of the brain in a more comprehensive and integrated manner, we reviewed a number of multimodal studies that combined two or more functional (fMRI and/or EEG) and structural (sMRI and/or DTI) modalities. In this review paper, we specifically focused on multimodal neuroimaging studies on cognition, aging, disease and behavior. We also compared multiple analysis approaches, including univariate and multivariate methods. The possible strengths and limitations of each method are highlighted, which can guide readers when selecting a method based on a given research question. In particular, we believe that multimodal fusion approaches will shed further light on the neuronal mechanisms underlying the major structural and functional pathophysiological features of both the healthy brain (e.g. development) or the diseased brain (e.g. mental illness) and, in the latter case, may provide a more sensitive measure than unimodal imaging for disease classification, e.g. multimodal biomarkers, which potentially can be used to support clinical diagnosis based on neuroimaging techniques.

Altered Small-World Brain Networks in Schizophrenia Patients during Working Memory Performance

Impairment of working memory (WM) performance in schizophrenia patients (SZ) is well-established. Compared to healthy controls (HC), SZ patients show aberrant blood oxygen level dependent (BOLD) activations and disrupted functional connectivity during WM performance. In this study, we examined the small-world network metrics computed from functional magnetic resonance imaging (fMRI) data collected as 35 HC and 35 SZ performed a Sternberg Item Recognition Paradigm (SIRP) at three WM load levels. Functional connectivity networks were built by calculating the partial correlation on preprocessed time courses of BOLD signal between task-related brain regions of interest (ROIs) defined by group independent component analysis (ICA). The networks were then thresholded within the small-world regime, resulting in undirected binarized small-world networks at different working memory loads. Our results showed: 1) at the medium WM load level, the networks in SZ showed a lower clustering coefficient and less local efficiency compared with HC; 2) in SZ, most network measures altered significantly as the WM load level increased from low to medium and from medium to high, while the network metrics were relatively stable in HC at different WM loads; and 3) the altered structure at medium WM load in SZ was related to their performance during the task, with longer reaction time related to lower clustering coefficient and lower local efficiency. These findings suggest brain connectivity in patients with SZ was more diffuse and less strongly linked locally in functional network at intermediate level of WM when compared to HC. SZ show distinctly inefficient and variable network structures in response to WM load increase, comparing to stable highly clustered network topologies in HC.

Modular Organization of Functional Network Connectivity in Healthy Controls and Patients with Schizophrenia during the Resting State.

Neuroimaging studies have shown that functional brain networks composed from select regions of interest have a modular community structure. However, the organization of functional network connectivity (FNC), comprising a purely data-driven network built from spatially independent brain components, is not yet clear. The aim of this study is to explore the modular organization of FNC in both healthy controls (HCs) and patients with schizophrenia (SZs). Resting state functional magnetic resonance imaging data of HCs and SZs were decomposed into independent components (ICs) by group independent component analysis (ICA). Then weighted brain networks (in which nodes are brain components) were built based on correlations between ICA time courses. Clustering coefficients and connectivity strength of the networks were computed. A dynamic branch cutting algorithm was used to identify modules of the FNC in HCs and SZs. Results show stronger connectivity strength and higher clustering coefficient in HCs with more and smaller modules in SZs. In addition, HCs and SZs had some different hubs. Our findings demonstrate altered modular architecture of the FNC in schizophrenia and provide insights into abnormal topological organization of intrinsic brain networks in this mental illness.

Altered Small-World Brain Networks in Temporal Lobe in Patients with Schizophrenia Performing an Auditory Oddball Task

The functional architecture of the human brain has been extensively described in terms of complex networks characterized by efficient small-world features. Recent functional magnetic resonance imaging (fMRI) studies have found altered small-world topological properties of brain functional networks in patients with schizophrenia (SZ) during the resting state. However, little is known about the small-world properties of brain networks in the context of a task. In this study, we investigated the topological properties of human brain functional networks derived from fMRI during an auditory oddball (AOD) task. Data were obtained from 20 healthy controls and 20 SZ; A left and a right task-related network which consisted of the top activated voxels in temporal lobe of each hemisphere were analyzed separately. All voxels were detected by group independent component analysis. Connectivity of the left and right task-related networks were estimated by partial correlation analysis and thresholded to construct a set of undirected graphs. The small-worldness values were decreased in both hemispheres in SZ. In addition, SZ showed longer shortest path length and lower global efficiency only in the left task-related networks. These results suggested small-world attributes are altered during the AOD task-related networks in SZ which provided further evidences for brain dysfunction of connectivity in SZ.

In Search of Multimodal Neuroimaging Biomarkers of Cognitive Deficits in Schizophrenia

BACKGROUND The cognitive deficits of schizophrenia are largely resistant to current treatments and thus are a lifelong illness burden. The Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) Consensus Cognitive Battery (MCCB) provides a reliable and valid assessment of cognition across major cognitive domains; however, the multimodal brain alterations specifically associated with MCCB in schizophrenia have not been examined. METHODS The interrelationships between MCCB and the abnormalities seen in three types of neuroimaging-derived maps-fractional amplitude of low-frequency fluctuations (fALFF) from resting-state functional magnetic resonance imaging (MRI), gray matter (GM) density from structural MRI, and fractional anisotropy from diffusion MRI-were investigated by using multiset canonical correlation analysis in data from 47 schizophrenia patients treated with antipsychotic medications and 50 age-matched healthy control subjects. RESULTS One multimodal component (canonical variant 8) was identified as both group differentiating and significantly correlated with the MCCB composite. It demonstrated 1) increased cognitive performance associated with higher fALFF (intensity of regional spontaneous brain activity) and higher GM volumes in thalamus, striatum, hippocampus, and the mid-occipital region, with co-occurring fractional anisotropy changes in superior longitudinal fascicules, anterior thalamic radiation, and forceps major; 2) higher fALFF but lower GM volume in dorsolateral prefrontal cortex related to worse cognition in schizophrenia; and 3) distinct domains of MCCB might exhibit dissociable multimodal signatures, e.g., increased fALFF in inferior parietal lobule particularly correlated with decreased social cognition. Medication dose did not relate to these findings in schizophrenia. CONCLUSIONS Our results suggest linked functional and structural deficits in distributed cortico-striato-thalamic circuits may be closely related to MCCB-measured cognitive impairments in schizophrenia.

Interaction among subsystems within default mode network diminished in schizophrenia patients: A dynamic connectivity approach

Default mode network (DMN) has been reported altered in schizophrenia (SZ) using static connectivity analysis. However, the studies on dynamic characteristics of DMN in SZ are still limited. In this work, we compare dynamic connectivity within DMN between 82 healthy controls (HC) and 82 SZ patients using resting-state fMRI. Firstly, dynamic DMN was computed using a sliding time window method for each subject. Then, the overall connectivity strengths were compared between two groups. Furthermore, we estimated functional connectivity states using K-means clustering, and then investigated group differences with respect to the connectivity strengths in states, the dwell time in each state, and the transition times between states. Finally, graph metrics of time-varying connectivity patterns and connectivity states were assessed. Results suggest that measured by the overall connectivity, HC showed stronger inter-subsystem interaction than patients. Compared to HC, patients spent more time in the states with nodes sparsely connected. For each state, SZ patients presented relatively weaker connectivity strengths mainly in inter-subsystem. Patients also exhibited lower values in averaged node strength, clustering coefficient, global efficiency, and local efficiency than HC. In summary, our findings indicate that SZ show impaired interaction among DMN subsystems, with a reduced central role for posterior cingulate cortex (PCC) and anterior medial prefrontal cortex (aMPFC) hubs as well as weaker interaction between dorsal medial prefrontal cortex (dMPFC) subsystem and medial temporal lobe (MTL) subsystem. For SZ, decreased integration of DMN may be associated with impaired ability in making self-other distinctions and coordinating present mental states with episodic decisions about future.