Coert Metz

Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms.

Efficiently obtaining a reliable coronary artery centerline from computed tomography angiography data is relevant in clinical practice. Whereas numerous methods have been presented for this purpose, up to now no standardized evaluation methodology has been published to reliably evaluate and compare the performance of the existing or newly developed coronary artery centerline extraction algorithms. This paper describes a standardized evaluation methodology and reference database for the quantitative evaluation of coronary artery centerline extraction algorithms. The contribution of this work is fourfold: (1) a method is described to create a consensus centerline with multiple observers, (2) well-defined measures are presented for the evaluation of coronary artery centerline extraction algorithms, (3) a database containing 32 cardiac CTA datasets with corresponding reference standard is described and made available, and (4) 13 coronary artery centerline extraction algorithms, implemented by different research groups, are quantitatively evaluated and compared. The presented evaluation framework is made available to the medical imaging community for benchmarking existing or newly developed coronary centerline extraction algorithms.

Nonrigid registration of dynamic medical imaging data using nD + t B-splines and a groupwise optimization approach

A registration method for motion estimation in dynamic medical imaging data is proposed. Registration is performed directly on the dynamic image, thus avoiding a bias towards a specifically chosen reference time point. Both spatial and temporal smoothness of the transformations are taken into account. Optionally, cyclic motion can be imposed, which can be useful for visualization (viewing the segmentation sequentially) or model building purposes. The method is based on a 3D (2D+time) or 4D (3D+time) free-form B-spline deformation model, a similarity metric that minimizes the intensity variances over time and constrained optimization using a stochastic gradient descent method with adaptive step size estimation. The method was quantitatively compared with existing registration techniques on synthetic data and 3D+t computed tomography data of the lungs. This showed subvoxel accuracy while delivering smooth transformations, and high consistency of the registration results. Furthermore, the accuracy of semi-automatic derivation of left ventricular volume curves from 3D+t computed tomography angiography data of the heart was evaluated. On average, the deviation from the curves derived from the manual annotations was approximately 3%. The potential of the method for other imaging modalities was shown on 2D+t ultrasound and 2D+t magnetic resonance images. The software is publicly available as an extension to the registration package elastix.

Standardized evaluation framework for evaluating coronary artery stenosis detection, stenosis quantification and lumen segmentation algorithms in computed tomography angiography

Though conventional coronary angiography (CCA) has been the standard of reference for diagnosing coronary artery disease in the past decades, computed tomography angiography (CTA) has rapidly emerged, and is nowadays widely used in clinical practice. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms devised to detect and quantify the coronary artery stenoses, and to segment the coronary artery lumen in CTA data. The objective of this evaluation framework is to demonstrate the feasibility of dedicated algorithms to: (1) (semi-)automatically detect and quantify stenosis on CTA, in comparison with quantitative coronary angiography (QCA) and CTA consensus reading, and (2) (semi-)automatically segment the coronary lumen on CTA, in comparison with experts manual annotation. A database consisting of 48 multicenter multivendor cardiac CTA datasets with corresponding reference standards are described and made available. The algorithms from 11 research groups were quantitatively evaluated and compared. The results show that (1) some of the current stenosis detection/quantification algorithms may be used for triage or as a second-reader in clinical practice, and that (2) automatic lumen segmentation is possible with a precision similar to that obtained by experts. The framework is open for new submissions through the website, at http://coronary.bigr.nl/stenoses/.

Evaluation framework for carotid bifurcation lumen segmentation and stenosis grading.

This paper describes an evaluation framework that allows a standardized and objective quantitative comparison of carotid artery lumen segmentation and stenosis grading algorithms. We describe the data repository comprising 56 multi-center, multi-vendor CTA datasets, their acquisition, the creation of the reference standard and the evaluation measures. This framework has been introduced at the MICCAI 2009 workshop 3D Segmentation in the Clinic: A Grand Challenge III, and we compare the results of eight teams that participated. These results show that automated segmentation of the vessel lumen is possible with a precision that is comparable to manual annotation. The framework is open for new submissions through the website http://cls2009.bigr.nl.

Coronary centerline extraction from CT coronary angiography images using a minimum cost path approach

PURPOSE The application and large-scale evaluation of minimum cost path approaches for coronary centerline extraction from computed tomography coronary angiography (CTCA) data and the development and evaluation of a novel method to reduce the user-interaction time. METHODS A semiautomatic method based on a minimum cost path approach is evaluated for two different cost functions. The first cost function is based on a frequently used vesselness measure and intensity information, and the second is a recently proposed cost function based on region statistics. User interaction is minimized to one or two mouse clicks distally in the coronary artery. The starting point for the minimum cost path search is automatically determined using a newly developed method that finds a point in the center of the aorta in one of the axial slices. This step ensures that all computationally expensive parts of the algorithm can be precomputed. RESULTS The performance of the aorta localization procedure was demonstrated by a success rate of 100% in 75 images. The success rate and accuracy of centerline extraction was quantitatively evaluated on 48 coronary arteries in 12 images by comparing extracted centerlines with a manually annotated reference standard. The method was able to extract 88% and 47% of the vessel center-lines correctly using the vesselness/intensity and region statistics cost function, respectively. For only the proximal part of the vessels these values were 97% and 86%, respectively. Accuracy of centerline extraction, defined as the average distance from correctly automatically extracted parts of the centerline to the reference standard, was 0.64 mm for the vesselness/intensity and 0.51 mm for the region statistics cost function. The interobserver variability was 99% for the success rate measure and 0.42 mm for the accuracy measure. Qualitative evaluation using the best performing cost function resulted in successful centerline extraction for 233 out of the 252 coronaries (92%) in 63 additional CTCA images. CONCLUSIONS The presented results, in combination with minimal user interaction and low computation time, show that minimum cost path approaches can effectively be applied as a preprocessing step for subsequent analysis in clinical practice and biomedical research.

Coronary Lumen Segmentation Using Graph Cuts and Robust Kernel Regression

This paper presents a novel method for segmenting the coronary lumen in CTA data. The method is based on graph cuts, with edge-weights depending on the intensity of the centerline, and robust kernel regression. A quantitative evaluation in 28 coronary arteries from 12 patients is performed by comparing the semi-automatic segmentations to manual annotations. This evaluation showed that the method was able to segment the coronary arteries with high accuracy, compared to manually annotated segmentations, which is reflected in a Dice coefficient of 0.85 and average symmetric surface distance of 0.22 mm.

Robust Shape Regression for Supervised Vessel Segmentation and its Application to Coronary Segmentation in CTA

This paper presents a vessel segmentation method which learns the geometry and appearance of vessels in medical images from annotated data and uses this knowledge to segment vessels in unseen images. Vessels are segmented in a coarse-to-fine fashion. First, the vessel boundaries are estimated with multivariate linear regression using image intensities sampled in a region of interest around an initialization curve. Subsequently, the position of the vessel boundary is refined with a robust nonlinear regression technique using intensity profiles sampled across the boundary of the rough segmentation and using information about plausible cross-sectional vessel shapes. The method was evaluated by quantitatively comparing segmentation results to manual annotations of 229 coronary arteries. On average the difference between the automatically obtained segmentations and manual contours was smaller than the inter-observer variability, which is an indicator that the method outperforms manual annotation. The method was also evaluated by using it for centerline refinement on 24 publicly available datasets of the Rotterdam Coronary Artery Evaluation Framework. Centerlines are extracted with an existing method and refined with the proposed method. This combination is currently ranked second out of 10 evaluated interactive centerline extraction methods. An additional qualitative expert evaluation in which 250 automatic segmentations were compared to manual segmentations showed that the automatically obtained contours were rated on average better than manual contours.

Bayesian tracking of elongated structures in 3D images

Tracking of tubular elongated structures is an important goal in a wide range of biomedical imaging applications. A Bayesian tube tracking algorithm is presented that allows to easily incorporate a priori knowledge. Because probabilistic tube tracking algorithms are computationally complex, steps towards a computational efficient implementation are suggested in this paper. The algorithm is evaluated on 2D and 3D synthetic data with different noise levels and clinical CTA data. The approach shows good performance on data with high levels of Gaussian noise.

Patient Specific 4D Coronary Models from ECG-gated CTA Data for Intra-operative Dynamic Alignment of CTA with X-ray Images

We present an approach to derive patient specific coronary models from ECG-gated CTA data and their application for the alignment of CTA with mono-plane X-ray imaging during interventional cardiology. A 4D (3D+t) deformation model of the coronary arteries is derived by (i) extraction of a 3D coronary model at an appropriate cardiac phase and (ii) non-rigid registration of the CTA images at different ECG phases to obtain a deformation model. The resulting 4D coronary model is aligned with the X-ray data using a novel 2D+t/3D+t registration approach. Model consistency and accuracy is evaluated using manually annotated coronary centerlines at systole and diastole as reference. Improvement of registration robustness by using the 2D+t/3D+t registration is successfully demonstrated by comparison of the actual X-ray cardiac phase with the automatically determined best matching phase in the 4D coronary model.

SEMI-AUTOMATIC CORONARY ARTERY CENTERLINE EXTRACTION IN COMPUTED TOMOGRAPHY ANGIOGRAPHY DATA

This paper presents a semi-automatic coronary centerline extraction algorithm for computed tomography angiography data. The method applies region growing to computed tomography angiography data and incorporates bifurcation and leak detection. The presented method is evaluated either on the original data and on data in which vessel-like structures have been enhanced. Semi-automatically extracted centerlines of the three main coronary arteries are compared with centerlines manually annotated by three observers, using an overlap and distance measure. The method successfully extracted vessel centerlines in up to 15 out of 18 evaluated cases, with a localization accuracy which was in the range of the interobserver variability. Vessel enhancement prior to centerline extraction did not improve the results