Chunliang Wang

Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms.

Efficiently obtaining a reliable coronary artery centerline from computed tomography angiography data is relevant in clinical practice. Whereas numerous methods have been presented for this purpose, up to now no standardized evaluation methodology has been published to reliably evaluate and compare the performance of the existing or newly developed coronary artery centerline extraction algorithms. This paper describes a standardized evaluation methodology and reference database for the quantitative evaluation of coronary artery centerline extraction algorithms. The contribution of this work is fourfold: (1) a method is described to create a consensus centerline with multiple observers, (2) well-defined measures are presented for the evaluation of coronary artery centerline extraction algorithms, (3) a database containing 32 cardiac CTA datasets with corresponding reference standard is described and made available, and (4) 13 coronary artery centerline extraction algorithms, implemented by different research groups, are quantitatively evaluated and compared. The presented evaluation framework is made available to the medical imaging community for benchmarking existing or newly developed coronary centerline extraction algorithms.

Iodinated Contrast Opacification Gradients in Normal Coronary Arteries Imaged with Prospectively ECG-Gated Single Heart Beat 320-Detector Row Computed Tomography

Background—To define and evaluate coronary contrast opacification gradients using prospectively ECG-gated single heart beat 320-detector row coronary angiography (CTA). Methods and Results—Thirty-six patients with normal coronary arteries determined by 320×0.5-mm detector row coronary CTA were retrospectively evaluated with customized image postprocessing software to measure Hounsfield Units at 1-mm intervals orthogonal to the artery center line. Linear regression determined correlation between mean Hounsfield Units and distance from the coronary ostium (regression slope defined as the distance gradient Gd), lumen cross-sectional area (Ga), and lumen short-axis diameter (Gs). For each gradient, differences between the 3 coronary arteries were analyzed with ANOVA. Linear regression determined correlations between measured gradients, heart rate, body mass index, and cardiac phase. To determine feasibility in lesions, all 3 gradients were evaluated in 22 consecutive patients with left anterior descending artery lesions ≥50% stenosis. For all 3 coronary arteries in all patients, the gradients Ga and Gs were significantly different from zero (P<0.0001), highly linear (Pearson r values, 0.77 to 0.84), and had no significant difference between the left anterior descending, left circumflex, and right coronary arteries (P>0.503). The distance gradient Gd demonstrated nonlinearities in a small number of vessels and was significantly smaller in the right coronary artery when compared with the left coronary system (P<0.001). Gradient variations between cardiac phases, heart rates, body mass index, and readers were low. Gradients in patients with lesions were significantly different (P<0.021) than in patients considered normal by CTA. Conclusions—Measurement of contrast opacification gradients from temporally uniform coronary CTA demonstrates feasibility and reproducibility in patients with normal coronary arteries. For all patients, the gradients defined with respect to the coronary lumen cross-sectional area and short-axis diameters are highly linear, not significantly influenced by the coronary artery (left anterior descending artery versus left circumflex versus right coronary artery), and have only small variation with respect to patient parameters. Preliminary evaluation of gradients across coronary artery lesions is promising but requires additional study.

MRBrainS challenge: online evaluation framework for brain image segmentation in 3T MRI scans

Many methods have been proposed for tissue segmentation in brain MRI scans. The multitude of methods proposed complicates the choice of one method above others. We have therefore established the MRBrainS online evaluation framework for evaluating (semi)automatic algorithms that segment gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF) on 3T brain MRI scans of elderly subjects (65–80 y). Participants apply their algorithms to the provided data, after which their results are evaluated and ranked. Full manual segmentations of GM, WM, and CSF are available for all scans and used as the reference standard. Five datasets are provided for training and fifteen for testing. The evaluated methods are ranked based on their overall performance to segment GM, WM, and CSF and evaluated using three evaluation metrics (Dice, H95, and AVD) and the results are published on the MRBrainS13 website. We present the results of eleven segmentation algorithms that participated in the MRBrainS13 challenge workshop at MICCAI, where the framework was launched, and three commonly used freeware packages: FreeSurfer, FSL, and SPM. The MRBrainS evaluation framework provides an objective and direct comparison of all evaluated algorithms and can aid in selecting the best performing method for the segmentation goal at hand.

Standardized evaluation framework for evaluating coronary artery stenosis detection, stenosis quantification and lumen segmentation algorithms in computed tomography angiography

Though conventional coronary angiography (CCA) has been the standard of reference for diagnosing coronary artery disease in the past decades, computed tomography angiography (CTA) has rapidly emerged, and is nowadays widely used in clinical practice. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms devised to detect and quantify the coronary artery stenoses, and to segment the coronary artery lumen in CTA data. The objective of this evaluation framework is to demonstrate the feasibility of dedicated algorithms to: (1) (semi-)automatically detect and quantify stenosis on CTA, in comparison with quantitative coronary angiography (QCA) and CTA consensus reading, and (2) (semi-)automatically segment the coronary lumen on CTA, in comparison with experts manual annotation. A database consisting of 48 multicenter multivendor cardiac CTA datasets with corresponding reference standards are described and made available. The algorithms from 11 research groups were quantitatively evaluated and compared. The results show that (1) some of the current stenosis detection/quantification algorithms may be used for triage or as a second-reader in clinical practice, and that (2) automatic lumen segmentation is possible with a precision similar to that obtained by experts. The framework is open for new submissions through the website, at http://coronary.bigr.nl/stenoses/.

Cloud-Based Evaluation of Anatomical Structure Segmentation and Landmark Detection Algorithms: VISCERAL Anatomy Benchmarks

Variations in the shape and appearance of anatomical structures in medical images are often relevant radiological signs of disease. Automatic tools can help automate parts of this manual process. A cloud-based evaluation framework is presented in this paper including results of benchmarking current state-of-the-art medical imaging algorithms for anatomical structure segmentation and landmark detection: the VISCERAL Anatomy benchmarks. The algorithms are implemented in virtual machines in the cloud where participants can only access the training data and can be run privately by the benchmark administrators to objectively compare their performance in an unseen common test set. Overall, 120 computed tomography and magnetic resonance patient volumes were manually annotated to create a standard Gold Corpus containing a total of 1295 structures and 1760 landmarks. Ten participants contributed with automatic algorithms for the organ segmentation task, and three for the landmark localization task. Different algorithms obtained the best scores in the four available imaging modalities and for subsets of anatomical structures. The annotation framework, resulting data set, evaluation setup, results and performance analysis from the three VISCERAL Anatomy benchmarks are presented in this article. Both the VISCERAL data set and Silver Corpus generated with the fusion of the participant algorithms on a larger set of non-manually-annotated medical images are available to the research community.

Fast level‐set based image segmentation using coherent propagation

PURPOSE The level-set method is known to require long computation time for 3D image segmentation, which limits its usage in clinical workflow. The goal of this study was to develop a fast level-set algorithm based on the coherent propagation method and explore its character using clinical datasets. METHODS The coherent propagation algorithm allows level set functions to converge faster by forcing the contour to move monotonically according to a predicted developing trend. Repeated temporary backwards propagation, caused by noise or numerical errors, is then avoided. It also makes it possible to detect local convergence, so that the parts of the boundary that have reached their final position can be excluded in subsequent iterations, thus reducing computation time. To compensate for the overshoot error, forward and backward coherent propagation is repeated periodically. This can result in fluctuations of great magnitude in parts of the contour. In this paper, a new gradual convergence scheme using a damping factor is proposed to address this problem. The new algorithm is also generalized to non-narrow band cases. Finally, the coherent propagation approach is combined with a new distance-regularized level set, which eliminates the needs of reinitialization of the distance. RESULTS Compared with the sparse field method implemented in the widely available ITKSnap software, the proposed algorithm is about 10 times faster when used for brain segmentation and about 100 times faster for aorta segmentation. Using a multiresolution approach, the new method achieved 50 times speed-up in liver segmentation. The Dice coefficient between the proposed method and the sparse field method is above 99% in most cases. CONCLUSIONS A generalized coherent propagation algorithm for level set evolution yielded substantial improvement in processing time with both synthetic datasets and medical images.

Evaluation and comparison of 3D intervertebral disc localization and segmentation methods for 3D T2 MR data: A grand challenge.

&NA; The evaluation of changes in Intervertebral Discs (IVDs) with 3D Magnetic Resonance (MR) Imaging (MRI) can be of interest for many clinical applications. This paper presents the evaluation of both IVD localization and IVD segmentation methods submitted to the Automatic 3D MRI IVD Localization and Segmentation challenge, held at the 2015 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI2015) with an on‐site competition. With the construction of a manually annotated reference data set composed of 25 3D T2‐weighted MR images acquired from two different studies and the establishment of a standard validation framework, quantitative evaluation was performed to compare the results of methods submitted to the challenge. Experimental results show that overall the best localization method achieves a mean localization distance of 0.8 mm and the best segmentation method achieves a mean Dice of 91.8%, a mean average absolute distance of 1.1 mm and a mean Hausdorff distance of 4.3 mm, respectively. The strengths and drawbacks of each method are discussed, which provides insights into the performance of different IVD localization and segmentation methods. HighlightsEstablish a standard framework with 25 manually annotated 3D T2 MRI data for an objective comparison of intervertebral disc (IVD) localization and segmentation methods.Investigate strengths and limitations of a representative selection of the state‐of‐the‐art IVD localization and segmentation methods with a challenge setup.Results achieved by the best algorithms in this study set new frontiers for IVD localization and segmentation from MR data. Graphical abstract Figure. No caption available.

Automatic Multi-organ Segmentation in Non-enhanced CT Datasets Using Hierarchical Shape Priors

An automatic multi-organ segmentation method using hierarchical-shape-prior guided level sets is proposed. The hierarchical shape priors are organized according to the anatomical hierarchy of the human body, so that major structures with less population variety are at the top and smaller structures with higher irregularities are linked at a lower level. The segmentation is performed in a top-down fashion, where major structures are first segmented with higher confidence, and their location information is then passed down to the lower level to initialize the segmentation, while boundary information from higher-level structures also provides extra cues to guide the segmentation of the lower-level structures. The proposed method was combined with a novel coherent propagating level set method, which is capable to detect local convergence and skip calculation in those parts, therefore significantly reducing computation time. Preliminary experiment results on a small number of clinical datasets are encouraging, the proposed method yielded a Dice coefficient above 90% for most major organs within a reasonable processing time without any user intervention.

Multi-organ Segmentation Using Shape Model Guided Local Phase Analysis

To improve the accuracy of multi-organ segmentation, we propose a model-based segmentation framework that utilizes the local phase information from paired quadrature filters to delineate the organ boundaries. Conventional local phase analysis based on local orientation has the drawback of outputting the same phases for black-to-white and white-to-black edges. This ambiguity could mislead the segmentation when two organs’ borders are too close. Using the gradient of the signed distance map of a statistical shape model, we could distinguish between these two types of edges and avoid the segmentation region leaking into another organ. In addition, we propose a level-set solution that integrates both the edge-based (represented by local phase) and region-based speed functions. Compared with previously proposed methods, the current method uses local adaptive weighting factors based on the confidence of the phase map (energy of the quadrature filters) instead of a global weighting factor to combine these two forces. In our preliminary studies, the proposed method outperformed conventional methods in terms of accuracy in a number of organ segmentation tasks.

A computational atlas of normal coronary artery anatomy

AIMS The aim of this study was to define the shape variations, including diameters and angles, of the major coronary artery bifurcations. METHODS AND RESULTS Computed tomographic angiograms from 300 adults with a zero calcium score and no stenoses were segmented for centreline and luminal models. A computational atlas was constructed enabling automatic quantification of 3D angles, diameters and lengths of the coronary tree. The diameter (mean±SD) of the left main coronary was 3.5±0.8 mm and the length 10.5±5.3 mm. The left main bifurcation angle (distal angle or angle B) was 89±21° for cases with, and 75±23° for those without an intermediate artery (p<0.001). Analogous measurements of diameter and angle were tabulated for the other major bifurcations (left anterior descending/diagonal, circumflex/obtuse marginal and right coronary crux). Novel 3D angle definitions are proposed and analysed. CONCLUSIONS A computational atlas of normal coronary artery anatomy provides distributions of diameter, lengths and bifurcation angles as well as more complex shape analysis. These data define normal anatomical variation, facilitating stent design, selection and optimal treatment strategy. These population models are necessary for accurate computational flow dynamics, can be 3D printed for bench testing bifurcation stents and deployment strategies, and can aid in the discussion of different approaches to the treatment of coronary bifurcations.