John Pluta

Multi-Atlas Segmentation with Joint Label Fusion

Multi-atlas segmentation is an effective approach for automatically labeling objects of interest in biomedical images. In this approach, multiple expert-segmented example images, called atlases, are registered to a target image, and deformed atlas segmentations are combined using label fusion. Among the proposed label fusion strategies, weighted voting with spatially varying weight distributions derived from atlas-target intensity similarity have been particularly successful. However, one limitation of these strategies is that the weights are computed independently for each atlas, without taking into account the fact that different atlases may produce similar label errors. To address this limitation, we propose a new solution for the label fusion problem in which weighted voting is formulated in terms of minimizing the total expectation of labeling error and in which pairwise dependency between atlases is explicitly modeled as the joint probability of two atlases making a segmentation error at a voxel. This probability is approximated using intensity similarity between a pair of atlases and the target image in the neighborhood of each voxel. We validate our method in two medical image segmentation problems: hippocampus segmentation and hippocampus subfield segmentation in magnetic resonance (MR) images. For both problems, we show consistent and significant improvement over label fusion strategies that assign atlas weights independently.

Neural correlates of voluntary and involuntary risk taking in the human brain: An fMRI Study of the Balloon Analog Risk Task (BART)

Increasing effort has been devoted to understanding the neural mechanisms underlying decision making during risk, yet little is known about the effect of voluntary choice on risk taking. The Balloon Analog Risk Task (BART), in which subjects inflate a virtual balloon that can either grow larger or explode [Lejuez, C.W., Read, J.P., Kahler, C.W., Richards, J.B., Ramsey, S.E., Stuart, G.L., Strong, D.R., Brown, R.A., 2002. Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task BART. J. Exp. Psychol. Appl. 8, 75-84.], provides an ecologically valid model to assess human risk taking propensity and behaviour. In the present study, we modified this task for use during functional magnetic resonance imaging (fMRI) and administered it in both an active choice mode and a passive no-choice mode in order to examine the neural correlates of voluntary and involuntary risk taking in the human brain. Voluntary risk in the active choice task is associated with robust activation in mesolimbic-frontal regions, including the midbrain, ventral and dorsal striatum, anterior insula, dorsal lateral prefrontal cortex (DLPFC), and anterior cingulate/medial frontal cortex (ACC/MFC), in addition to activation in visual pathway regions. However, these mesolimbic-frontal activation patterns were not observed for involuntary risk in the passive no-choice task. Decision making was associated with neural activity in the right DLPFC. These findings demonstrate the utility of the modified BART paradigms for using during fMRI to assess risk taking in the human brain, and suggest that recruitment of the brain mesolimbic-frontal pathway during risk-taking is contingent upon the agency of the risk taker. The present paradigm may be extended to pathological populations to determine the specific neural components of their impaired risk behavior.

A high-resolution computational atlas of the human hippocampus from postmortem magnetic resonance imaging at 9.4 T

This paper describes the construction of a computational anatomical atlas of the human hippocampus. The atlas is derived from high-resolution 9.4 Tesla MRI of postmortem samples. The main subfields of the hippocampus (cornu ammonis fields CA1, CA2/3; the dentate gyrus; and the vestigial hippocampal sulcus) are labeled in the images manually using a combination of distinguishable image features and geometrical features. A synthetic average image is derived from the MRI of the samples using shape and intensity averaging in the diffeomorphic non-linear registration framework, and a consensus labeling of the template is generated. The agreement of the consensus labeling with manual labeling of each sample is measured, and the effect of aiding registration with landmarks and manually generated mask images is evaluated. The atlas is provided as an online resource with the aim of supporting subfield segmentation in emerging hippocampus imaging and image analysis techniques. An example application examining subfield-level hippocampal atrophy in temporal lobe epilepsy demonstrates the application of the atlas to in vivo studies.

Automated volumetry and regional thickness analysis of hippocampal subfields and medial temporal cortical structures in mild cognitive impairment

We evaluate a fully automatic technique for labeling hippocampal subfields and cortical subregions in the medial temporal lobe in in vivo 3 Tesla MRI. The method performs segmentation on a T2‐weighted MRI scan with 0.4 × 0.4 × 2.0 mm3 resolution, partial brain coverage, and oblique orientation. Hippocampal subfields, entorhinal cortex, and perirhinal cortex are labeled using a pipeline that combines multi‐atlas label fusion and learning‐based error correction. In contrast to earlier work on automatic subfield segmentation in T2‐weighted MRI [Yushkevich et al., 2010], our approach requires no manual initialization, labels hippocampal subfields over a greater anterior‐posterior extent, and labels the perirhinal cortex, which is further subdivided into Brodmann areas 35 and 36. The accuracy of the automatic segmentation relative to manual segmentation is measured using cross‐validation in 29 subjects from a study of amnestic mild cognitive impairment (aMCI) and is highest for the dentate gyrus (Dice coefficient is 0.823), CA1 (0.803), perirhinal cortex (0.797), and entorhinal cortex (0.786) labels. A larger cohort of 83 subjects is used to examine the effects of aMCI in the hippocampal region using both subfield volume and regional subfield thickness maps. Most significant differences between aMCI and healthy aging are observed bilaterally in the CA1 subfield and in the left Brodmann area 35. Thickness analysis results are consistent with volumetry, but provide additional regional specificity and suggest nonuniformity in the effects of aMCI on hippocampal subfields and MTL cortical subregions. Hum Brain Mapp, 36:258–287, 2015.

A learning-based wrapper method to correct systematic errors in automatic image segmentation: Consistently improved performance in hippocampus, cortex and brain segmentation☆

We propose a simple but generally applicable approach to improving the accuracy of automatic image segmentation algorithms relative to manual segmentations. The approach is based on the hypothesis that a large fraction of the errors produced by automatic segmentation are systematic, i.e., occur consistently from subject to subject, and serves as a wrapper method around a given host segmentation method. The wrapper method attempts to learn the intensity, spatial and contextual patterns associated with systematic segmentation errors produced by the host method on training data for which manual segmentations are available. The method then attempts to correct such errors in segmentations produced by the host method on new images. One practical use of the proposed wrapper method is to adapt existing segmentation tools, without explicit modification, to imaging data and segmentation protocols that are different from those on which the tools were trained and tuned. An open-source implementation of the proposed wrapper method is provided, and can be applied to a wide range of image segmentation problems. The wrapper method is evaluated with four host brain MRI segmentation methods: hippocampus segmentation using FreeSurfer (Fischl et al., 2002); hippocampus segmentation using multi-atlas label fusion (Artaechevarria et al., 2009); brain extraction using BET (Smith, 2002); and brain tissue segmentation using FAST (Zhang et al., 2001). The wrapper method generates 72%, 14%, 29% and 21% fewer erroneously segmented voxels than the respective host segmentation methods. In the hippocampus segmentation experiment with multi-atlas label fusion as the host method, the average Dice overlap between reference segmentations and segmentations produced by the wrapper method is 0.908 for normal controls and 0.893 for patients with mild cognitive impairment. Average Dice overlaps of 0.964, 0.905 and 0.951 are obtained for brain extraction, white matter segmentation and gray matter segmentation, respectively.

Structural consequences of diffuse traumatic brain injury: A large deformation tensor-based morphometry study

Traumatic brain injury (TBI) is one of the most common causes of long-term disability. Despite the importance of identifying neuropathology in individuals with chronic TBI, methodological challenges posed at the stage of inter-subject image registration have hampered previous voxel-based MRI studies from providing a clear pattern of structural atrophy after TBI. We used a novel symmetric diffeomorphic image normalization method to conduct a tensor-based morphometry (TBM) study of TBI. The key advantage of this method is that it simultaneously estimates an optimal template brain and topology preserving deformations between this template and individual subject brains. Detailed patterns of atrophies are then revealed by statistically contrasting control and subject deformations to the template space. Participants were 29 survivors of TBI and 20 control subjects who were matched in terms of age, gender, education, and ethnicity. Localized volume losses were found most prominently in white matter regions and the subcortical nuclei including the thalamus, the midbrain, the corpus callosum, the mid- and posterior cingulate cortices, and the caudate. Significant voxel-wise volume loss clusters were also detected in the cerebellum and the frontal/temporal neocortices. Volume enlargements were identified largely in ventricular regions. A similar pattern of results was observed in a subgroup analysis where we restricted our analysis to the 17 TBI participants who had no macroscopic focal lesions (total lesion volume >1.5 cm(3)). The current study confirms, extends, and partly challenges previous structural MRI studies in chronic TBI. By demonstrating that a large deformation image registration technique can be successfully combined with TBM to identify TBI-induced diffuse structural changes with greater precision, our approach is expected to increase the sensitivity of future studies examining brain-behavior relationships in the TBI population.

Quantitative comparison of 21 protocols for labeling hippocampal subfields and parahippocampal subregions in in vivo MRI: Towards a harmonized segmentation protocol

OBJECTIVE An increasing number of human in vivo magnetic resonance imaging (MRI) studies have focused on examining the structure and function of the subfields of the hippocampal formation (the dentate gyrus, CA fields 1-3, and the subiculum) and subregions of the parahippocampal gyrus (entorhinal, perirhinal, and parahippocampal cortices). The ability to interpret the results of such studies and to relate them to each other would be improved if a common standard existed for labeling hippocampal subfields and parahippocampal subregions. Currently, research groups label different subsets of structures and use different rules, landmarks, and cues to define their anatomical extents. This paper characterizes, both qualitatively and quantitatively, the variability in the existing manual segmentation protocols for labeling hippocampal and parahippocampal substructures in MRI, with the goal of guiding subsequent work on developing a harmonized substructure segmentation protocol. METHOD MRI scans of a single healthy adult human subject were acquired both at 3 T and 7 T. Representatives from 21 research groups applied their respective manual segmentation protocols to the MRI modalities of their choice. The resulting set of 21 segmentations was analyzed in a common anatomical space to quantify similarity and identify areas of agreement. RESULTS The differences between the 21 protocols include the region within which segmentation is performed, the set of anatomical labels used, and the extents of specific anatomical labels. The greatest overall disagreement among the protocols is at the CA1/subiculum boundary, and disagreement across all structures is greatest in the anterior portion of the hippocampal formation relative to the body and tail. CONCLUSIONS The combined examination of the 21 protocols in the same dataset suggests possible strategies towards developing a harmonized subfield segmentation protocol and facilitates comparison between published studies.

Bias in estimation of hippocampal atrophy using deformation-based morphometry arises from asymmetric global normalization: an illustration in ADNI 3 T MRI data.

Measurement of brain change due to neurodegenerative disease and treatment is one of the fundamental tasks of neuroimaging. Deformation-based morphometry (DBM) has been long recognized as an effective and sensitive tool for estimating the change in the volume of brain regions over time. This paper demonstrates that a straightforward application of DBM to estimate the change in the volume of the hippocampus can result in substantial bias, i.e., an overestimation of the rate of change in hippocampal volume. In ADNI data, this bias is manifested as a non-zero intercept of the regression line fitted to the 6 and 12 month rates of hippocampal atrophy. The bias is further confirmed by applying DBM to repeat scans of subjects acquired on the same day. This bias appears to be the result of asymmetry in the interpolation of baseline and followup images during longitudinal image registration. Correcting this asymmetry leads to bias-free atrophy estimation.

Histology-derived volumetric annotation of the human hippocampal subfields in postmortem MRI.

Recently, there has been a growing effort to analyze the morphometry of hippocampal subfields using both in vivo and postmortem magnetic resonance imaging (MRI). However, given that boundaries between subregions of the hippocampal formation (HF) are conventionally defined on the basis of microscopic features that often lack discernible signature in MRI, subfield delineation in MRI literature has largely relied on heuristic geometric rules, the validity of which with respect to the underlying anatomy is largely unknown. The development and evaluation of such rules are challenged by the limited availability of data linking MRI appearance to microscopic hippocampal anatomy, particularly in three dimensions (3D). The present paper, for the first time, demonstrates the feasibility of labeling hippocampal subfields in a high resolution volumetric MRI dataset based directly on microscopic features extracted from histology. It uses a combination of computational techniques and manual post-processing to map subfield boundaries from a stack of histology images (obtained with 200μm spacing and 5μm slice thickness; stained using the Kluver-Barrera method) onto a postmortem 9.4Tesla MRI scan of the intact, whole hippocampal formation acquired with 160μm isotropic resolution. The histology reconstruction procedure consists of sequential application of a graph-theoretic slice stacking algorithm that mitigates the effects of distorted slices, followed by iterative affine and diffeomorphic co-registration to postmortem MRI scans of approximately 1cm-thick tissue sub-blocks acquired with 200μm isotropic resolution. These 1cm blocks are subsequently co-registered to the MRI of the whole HF. Reconstruction accuracy is evaluated as the average displacement error between boundaries manually delineated in both the histology and MRI following the sequential stages of reconstruction. The methods presented and evaluated in this single-subject study can potentially be applied to multiple hippocampal tissue samples in order to construct a histologically informed MRI atlas of the hippocampal formation.

Multivariate analysis of structural and diffusion imaging in traumatic brain injury.

RATIONALE AND OBJECTIVES Diffusion tensor (DT) and T1 structural magnetic resonance images provide unique and complementary tools for quantifying the living brain. We leverage both modalities in a diffeomorphic normalization method that unifies analysis of clinical datasets in a consistent and inherently multivariate (MV) statistical framework. We use this technique to study MV effects of traumatic brain injury (TBI). MATERIALS AND METHODS We contrast T1 and DT image-based measurements in the thalamus and hippocampus of 12 TBI survivors and nine matched controls normalized to a combined DT and T1 template space. The normalization method uses maps that are topology-preserving and unbiased. Normalization is based on the full tensor of information at each voxel and, simultaneously, the similarity between high-resolution features derived from T1 data. The technique is termed symmetric normalization for MV neuroanatomy (SyNMN). Voxel-wise MV statistics on the local volume and mean diffusion are assessed with Hotellings T(2) test with correction for multiple comparisons. RESULTS TBI significantly (false discovery rate P < .05) reduces volume and increases mean diffusion at coincident locations in the mediodorsal thalamus and anterior hippocampus. CONCLUSIONS SyNMN reveals evidence that TBI compromises the limbic system. This TBI morphometry study and an additional performance evaluation contrasting SyNMN with other methods suggest that the DT component may aid normalization quality.