Fan Deng

DICCCOL: Dense Individualized and Common Connectivity-Based Cortical Landmarks

Is there a common structural and functional cortical architecture that can be quantitatively encoded and precisely reproduced across individuals and populations? This question is still largely unanswered due to the vast complexity, variability, and nonlinearity of the cerebral cortex. Here, we hypothesize that the common cortical architecture can be effectively represented by group-wise consistent structural fiber connections and take a novel data-driven approach to explore the cortical architecture. We report a dense and consistent map of 358 cortical landmarks, named Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOLs). Each DICCCOL is defined by group-wise consistent white-matter fiber connection patterns derived from diffusion tensor imaging (DTI) data. Our results have shown that these 358 landmarks are remarkably reproducible over more than one hundred human brains and possess accurate intrinsically established structural and functional cross-subject correspondences validated by large-scale functional magnetic resonance imaging data. In particular, these 358 cortical landmarks can be accurately and efficiently predicted in a new single brain with DTI data. Thus, this set of 358 DICCCOL landmarks comprehensively encodes the common structural and functional cortical architectures, providing opportunities for many applications in brain science including mapping human brain connectomes, as demonstrated in this work.

Axonal Fiber Terminations Concentrate on Gyri

Convoluted cortical folding and neuronal wiring are 2 prominent attributes of the mammalian brain. However, the macroscale intrinsic relationship between these 2 general cross-species attributes, as well as the underlying principles that sculpt the architecture of the cerebral cortex, remains unclear. Here, we show that the axonal fibers connected to gyri are significantly denser than those connected to sulci. In human, chimpanzee, and macaque brains, a dominant fraction of axonal fibers were found to be connected to the gyri. This finding has been replicated in a range of mammalian brains via diffusion tensor imaging and high-angular resolution diffusion imaging. These results may have shed some lights on fundamental mechanisms for development and organization of the cerebral cortex, suggesting that axonal pushing is a mechanism of cortical folding.

Individualized ROI Optimization via Maximization of Group-wise Consistency of Structural and Functional Profiles

Studying connectivities among functional brain regions and the functional dynamics on brain networks has drawn increasing interest. A fundamental issue that affects functional connectivity and dynamics studies is how to determine the best possible functional brain regions or ROIs (regions of interest) for a group of individuals, since the connectivity measurements are heavily dependent on ROI locations. Essentially, identification of accurate, reliable and consistent corresponding ROIs is challenging due to the unclear boundaries between brain regions, variability across individuals, and nonlinearity of the ROIs. In response to these challenges, this paper presents a novel methodology to computationally optimize ROIs locations derived from task-based fMRI data for individuals so that the optimized ROIs are more consistent, reproducible and predictable across brains. Our computational strategy is to formulate the individual ROI location optimization as a group variance minimization problem, in which group-wise consistencies in functional/structural connectivity patterns and anatomic profiles are defined as optimization constraints. Our experimental results from multimodal fMRI and DTI data show that the optimized ROIs have significantly improved consistency in structural and functional profiles across individuals. These improved functional ROIs with better consistency could contribute to further study of functional interaction and dynamics in the human brain.

Visual analytics of brain networks.

Identification of regions of interest (ROIs) is a fundamental issue in brain network construction and analysis. Recent studies demonstrate that multimodal neuroimaging approaches and joint analysis strategies are crucial for accurate, reliable and individualized identification of brain ROIs. In this paper, we present a novel approach of visual analytics and its open-source software for ROI definition and brain network construction. By combining neuroscience knowledge and computational intelligence capabilities, visual analytics can generate accurate, reliable and individualized ROIs for brain networks via joint modeling of multimodal neuroimaging data and an intuitive and real-time visual analytics interface. Furthermore, it can be used as a functional ROI optimization and prediction solution when fMRI data is unavailable or inadequate. We have applied this approach to an operation span working memory fMRI/DTI dataset, a schizophrenia DTI/resting state fMRI (R-fMRI) dataset, and a mild cognitive impairment DTI/R-fMRI dataset, in order to demonstrate the effectiveness of visual analytics. Our experimental results are encouraging.

Discovering dense and consistent landmarks in the brain

The lack of consistent and reliable functionally meaningful landmarks in the brain has significantly hampered the advancement of brain imaging studies. In this paper, we use white matter fiber connectivity patterns, obtained from diffusion tensor imaging (DTI) data, as predictors of brain function, and to discover a dense, reliable and consistent map of brain landmarks within and across individuals. The general principles and our strategies are as follows. 1) Each brain landmark should have consistent structural fiber connectivity pattern across a group of subjects. We will quantitatively measure the similarity of the fiber bundles emanating from the corresponding landmarks via a novel trace-map approach, and then optimize the locations of these landmarks by maximizing the group-wise consistency of the shape patterns of emanating fiber bundles. 2) The landmark map should be dense and distributed all over major functional brain regions. We will initialize a dense and regular grid map of approximately 2000 landmarks that cover the whole brains in different subjects via linear brain image registration. 3) The dense map of brain landmarks should be reproducible and predictable in different datasets of various subject populations. The approaches and results in the above two steps are evaluated and validated via reproducibility studies. The dense map of brain landmarks can be reliably and accurately replicated in a new DTI dataset such that the landmark map can be used as a predictive model. Our experiments show promising results, and a subset of the discovered landmarks are validated via task-based fMRI.

Bridging low-level features and high-level semantics via fMRI brain imaging for video classification

The multimedia content analysis community has made significant effort to bridge the gap between low-level features and high-level semantics perceived by human cognitive systems such as real-world objects and concepts. In the two fields of multimedia analysis and brain imaging, both topics of low-level features and high level semantics are extensively studied. For instance, in the multimedia analysis field, many algorithms are available for multimedia feature extraction, and benchmark datasets are available such as the TRECVID. In the brain imaging field, brain regions that are responsible for vision, auditory perception, language, and working memory are well studied via functional magnetic resonance imaging (fMRI). This paper presents our initial effort in marrying these two fields in order to bridge the gaps between low-level features and high-level semantics via fMRI brain imaging. Our experimental paradigm is that we performed fMRI brain imaging when university student subjects watched the video clips selected from the TRECVID datasets. At current stage, we focus on the three concepts of sports, weather, and commercial-/advertisement specified in the TRECVID 2005. Meanwhile, the brain regions in vision, auditory, language, and working memory networks are quantitatively localized and mapped via task-based paradigm fMRI, and the fMRI responses in these regions are used to extract features as the representation of the brains comprehension of semantics. Our computational framework aims to learn the most relevant low-level feature sets that best correlate the fMRI-derived semantics based on the training videos with fMRI scans, and then the learned models are applied to larger scale test datasets without fMRI scans for category classifications. Our result shows that: 1) there are meaningful couplings between brains fMRI responses and video stimuli, suggesting the validity of linking semantics and low-level features via fMRI; 2) The computationally learned low-level feature sets from fMRI-derived semantic features can significantly improve the classification of video categories in comparison with that based on original low-level features.

A functional model of cortical gyri and sulci

Diffusion tensor imaging (DTI) and high angular resolution diffusion imaging (HARDI) have been broadly used in the neuroimaging field to investigate the macro-scale fiber connection patterns in the cerebral cortex. Our recent analyses of DTI and HARDI data demonstrated that gyri are connected by denser, streamlined fibers than sulci are. Inspired by this finding and motivated by the fact that DTI-derived fibers provide the structural substrates for functional connectivity, we hypothesize that gyri are global functional connection centers and sulci are local functional units. To test this functional model of gyri and sulci, we examined the structural and functional connectivity among the landmarks on the selected gyral/sulcal areas in the frontal/parietal lobe and in the whole cerebral cortex via multimodal DTI and resting state fMRI (R-fMRI) datasets. Our results demonstrate that functional connectivity is strong among gyri, weak among sulci, and moderate between gyri and sulci. These results suggest that gyri are functional connection centers that exchange information among remote structurally connected gyri and neighboring sulci, while sulci communicate directly with their neighboring gyri and indirectly with other cortical regions through gyri. This functional model of gyri and sulci has been supported by a series of experiments, and provides novel perspectives on the functional architecture of the cerebral cortex.

Automatic cortical surface parcellation based on fiber density information

It is widely believed that the structural connectivity of a brain region largely determines its function. High resolution Diffusion Tensor Imaging (DTI) is now able to image the axonal fibers in vivo and the DTI tractography result provides rich connectivity information. In this paper, a novel method is proposed to employ fiber density information for automatic cortical parcellation based on the premise that fibers connecting to the same cortical region should be within the same functional brain network and their aggregation on the cortex can define a functionally coherent region. This method consists of three steps. Firstly, the fiber density is calculated on the cortical surface. Secondly, a flow field is obtained by calculating the fiber density gradient and a flow field tracking method is utilized for cortical parcellation. Finally, an atlas-based warping method is used to label the parcellated regions. Our method was applied to parcellate and label the cortical surfaces of eight healthy brain DTI images, and interesting results are obtained. In addition, the labeled regions are used as ROIs to construct structural networks for different brains, and the graph properties of these networks are measured.

FMRI Signal Analysis Using Empirical Mean Curve Decomposition

Functional magnetic resonance imaging (fMRI) time series is nonlinear and composed of components at multiple temporal scales, which presents significant challenges to its analysis. In the literature, significant effort has been devoted into model-based fMRI signal analysis, while much less attention has been directed to data-driven fMRI signal analysis. In this paper, we present a novel data-driven multiscale signal decomposition framework named empirical mean curve decomposition (EMCD). Targeted on functional brain mapping, the EMCD optimizes mean envelopes from fMRI signals and iteratively extracts coarser-to-finer scale signal components. The EMCD framework was applied to infer meaningful low-frequency information from blood oxygenation level-dependent signals from resting-state fMRI, task-based fMRI, and natural stimulus fMRI, and promising results are obtained.

Retrieving video shots in semantic brain imaging space using manifold-ranking

In recent two decades, a large amount of effort has been devoted to content-based video retrieval (CBVR), which aims to manage large-scale video databases in an effective way based on visual features such as color, shape, texture, and motion. However, the performance of CBVR systems is still far from satisfaction due to the well-known semantic gap. In order to alleviate the problem, this paper proposes a novel retrieval methodology using semantic features derived from brain imaging space (BIS) that reflects brain responses and interactions under natural stimulus of video watching. A mapping from visual features to semantic features in BIS is built through Gaussian process regression. A manifold structure is then inferred where video key frames are represented by mapped feature vectors in BIS. Finally, the manifold-ranking algorithm concerning the relationship among all data is applied to measure the similarity between key frames. Preliminary experimental results on the TRECVID 2005 dataset demonstrate the superiority of the proposed work in comparison with traditional methods.