Hortense A. Kirisli

Standardized evaluation framework for evaluating coronary artery stenosis detection, stenosis quantification and lumen segmentation algorithms in computed tomography angiography

Though conventional coronary angiography (CCA) has been the standard of reference for diagnosing coronary artery disease in the past decades, computed tomography angiography (CTA) has rapidly emerged, and is nowadays widely used in clinical practice. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms devised to detect and quantify the coronary artery stenoses, and to segment the coronary artery lumen in CTA data. The objective of this evaluation framework is to demonstrate the feasibility of dedicated algorithms to: (1) (semi-)automatically detect and quantify stenosis on CTA, in comparison with quantitative coronary angiography (QCA) and CTA consensus reading, and (2) (semi-)automatically segment the coronary lumen on CTA, in comparison with experts manual annotation. A database consisting of 48 multicenter multivendor cardiac CTA datasets with corresponding reference standards are described and made available. The algorithms from 11 research groups were quantitatively evaluated and compared. The results show that (1) some of the current stenosis detection/quantification algorithms may be used for triage or as a second-reader in clinical practice, and that (2) automatic lumen segmentation is possible with a precision similar to that obtained by experts. The framework is open for new submissions through the website, at http://coronary.bigr.nl/stenoses/.

Evaluation of a multi-atlas based method for segmentation of cardiac CTA data: a large-scale, multicenter, and multivendor study.

PURPOSE Computed tomography angiography (CTA) is increasingly used for the diagnosis of coronary artery disease (CAD). However, CTA is not commonly used for the assessment of ventricular and atrial function, although functional information extracted from CTA data is expected to improve the diagnostic value of the examination. In clinical practice, the extraction of ventricular and atrial functional information, such as stroke volume and ejection fraction, requires accurate delineation of cardiac chambers. In this paper, we investigated the accuracy and robustness of cardiac chamber delineation using a multiatlas based segmentation method on multicenter and multivendor CTA data. METHODS A fully automatic multiatlas based method for segmenting the whole heart (i.e., the outer surface of the pericardium) and cardiac chambers from CTA data is presented and evaluated. In the segmentation approach, eight atlas images are registered to a new patients CTA scan. The eight corresponding manually labeled images are then propagated and combined using a per voxel majority voting procedure, to obtain a cardiac segmentation. RESULTS The method was evaluated on a multicenter/multivendor database, consisting of (1) a set of 1380 Siemens scans from 795 patients and (2) a set of 60 multivendor scans (Siemens, Philips, and GE) from different patients, acquired in six different institutions worldwide. A leave-one-out 3D quantitative validation was carried out on the eight atlas images; we obtained a mean surface-to-surface error of 0.94 +/- 1.12 mm and an average Dice coefficient of 0.93 was achieved. A 2D quantitative evaluation was performed on the 60 multivendor data sets. Here, we observed a mean surface-to-surface error of 1.26 +/- 1.25 mm and an average Dice coefficient of 0.91 was achieved. In addition to this quantitative evaluation, a large-scale 2D and 3D qualitative evaluation was performed on 1380 and 140 images, respectively. Experts evaluated that 49% of the 1380 images were very accurately segmented (below 1 mm error) and that 29% were accurately segmented (error between 1 and 3 mm), which demonstrates the robustness of the presented method. CONCLUSIONS A fully automatic method for whole heart and cardiac chamber segmentation was presented and evaluated using multicenter/multivendor CTA data. The accuracy and robustness of the method were demonstrated by successfully applying the method to 1420 multicenter/ multivendor data sets.

Automatic quantification of epicardial fat volume on non‐enhanced cardiac CT scans using a multi‐atlas segmentation approach

PURPOSE There is increasing evidence that epicardial fat (i.e., adipose tissue contained within the pericardium) plays an important role in the development of cardiovascular disease. Obtaining the epicardial fat volume from routinely performed non-enhanced cardiac CT scans is therefore of clinical interest. The purpose of this work is to investigate the feasibility of automatic pericardium segmentation and subsequent quantification of epicardial fat on non-enhanced cardiac CT scans. METHODS Imaging data of 98 randomly selected subjects belonging to a larger cohort of subjects who underwent a cardiac CT scan at our medical center were retrieved. The data were acquired on two different scanners. Automatic multi-atlas based method for segmenting the pericardium and calculating the epicardial fat volume has been developed. The performance of the method was assessed by (1) comparing the automatically segmented pericardium to a manually annotated reference standard, (2) comparing the automatically obtained epicardial fat volumes to those obtained manually, and (3) comparing the accuracy of the automatic results to the inter-observer variability. RESULTS Automatic segmentation of the pericardium was achieved with a Dice similarity index of 89.1 ± 2.6% with respect to Observer 1 and 89.2 ± 1.9% with respect to Observer 2. The correlation between the automatic method and the manual observers with respect to the epicardial fat volume computed as the Pearsons correlation coefficient (R) was 0.91 (P < 0.001) for both observers. The inter-observer study resulted in a Dice similarity index of 89.0 ± 2.4% for segmenting the pericardium and a Pearsons correlation coefficient of 0.92 (P<0.001) for computation of the epicardial fat volume. CONCLUSIONS The authors developed a fully automatic method that is capable of segmenting the pericardium and quantifying epicardial fat on non-enhanced cardiac CT scans. The authors demonstrated the feasibility of using this method to replace manual annotations by showing that the automatic method performs as good as manual annotation on a large dataset.

Cardiac MR perfusion image processing techniques: A survey

First-pass cardiac MR perfusion (CMRP) imaging has undergone rapid technical advancements in recent years. Although the efficacy of CMRP imaging in the assessment of coronary artery diseases (CAD) has been proven, its clinical use is still limited. This limitation stems, in part, from manual interaction required to quantitatively analyze the large amount of data. This process is tedious, time-consuming, and prone to operator bias. Furthermore, acquisition and patient related image artifacts reduce the accuracy of quantitative perfusion assessment. With the advent of semi- and fully automatic image processing methods, not only the challenges posed by these artifacts have been overcome to a large extent, but a significant reduction has also been achieved in analysis time and operator bias. Despite an extensive literature on such image processing methods, to date, no survey has been performed to discuss this dynamic field. The purpose of this article is to provide an overview of the current state of the field with a categorical study, along with a future perspective on the clinical acceptance of image processing methods in the diagnosis of CAD.

Regression-Based Cardiac Motion Prediction From Single-Phase CTA

State of the art cardiac computed tomography (CT) enables the acquisition of imaging data of the heart over the entire cardiac cycle at concurrent high spatial and temporal resolution. However, in clinical practice, acquisition is increasingly limited to 3-D images. Estimating the shape of the cardiac structures throughout the entire cardiac cycle from a 3-D image is therefore useful in applications such as the alignment of preoperative computed tomography angiography (CTA) to intra-operative X-ray images for improved guidance in coronary interventions. We hypothesize that the motion of the heart is partially explained by its shape and therefore investigate the use of three regression methods for motion estimation from single-phase shape information. Quantitative evaluation on 150 4-D CTA images showed a small, but statistically significant, increase in the accuracy of the predicted shape sequences when using any of the regression methods, compared to shape-independent motion prediction by application of the mean motion. The best results were achieved using principal component regression resulting in point-to-point errors of 2.3±0.5 mm, compared to values of 2.7±0.6 mm for shape-independent motion estimation. Finally, we showed that this significant difference withstands small variations in important parameter settings of the landmarking procedure.

User Interaction in Semi-Automatic Segmentation of Organs at Risk: a Case Study in Radiotherapy

Accurate segmentation of organs at risk is an important step in radiotherapy planning. Manual segmentation being a tedious procedure and prone to inter- and intra-observer variability, there is a growing interest in automated segmentation methods. However, automatic methods frequently fail to provide satisfactory result, and post-processing corrections are often needed. Semi-automatic segmentation methods are designed to overcome these problems by combining physicians’ expertise and computers’ potential. This study evaluates two semi-automatic segmentation methods with different types of user interactions, named the “strokes” and the “contour”, to provide insights into the role and impact of human-computer interaction. Two physicians participated in the experiment. In total, 42 case studies were carried out on five different types of organs at risk. For each case study, both the human-computer interaction process and quality of the segmentation results were measured subjectively and objectively. Furthermore, different measures of the process and the results were correlated. A total of 36 quantifiable and ten non-quantifiable correlations were identified for each type of interaction. Among those pairs of measures, 20 of the contour method and 22 of the strokes method were strongly or moderately correlated, either directly or inversely. Based on those correlated measures, it is concluded that: (1) in the design of semi-automatic segmentation methods, user interactions need to be less cognitively challenging; (2) based on the observed workflows and preferences of physicians, there is a need for flexibility in the interface design; (3) the correlated measures provide insights that can be used in improving user interaction design.

Segmentation of multiple heart cavities in 3-D transesophageal ultrasound images

Three-dimensional transesophageal echocardiography (TEE) is an excellent modality for real-time visualization of the heart and monitoring of interventions. To improve the usability of 3-D TEE for intervention monitoring and catheter guidance, automated segmentation is desired. However, 3-D TEE segmentation is still a challenging task due to the complex anatomy with multiple cavities, the limited TEE field of view, and typical ultrasound artifacts. We propose to segment all cavities within the TEE view with a multi-cavity active shape model (ASM) in conjunction with a tissue/blood classification based on a gamma mixture model (GMM). 3-D TEE image data of twenty patients were acquired with a Philips X7-2t matrix TEE probe. Tissue probability maps were estimated by a two-class (blood/tissue) GMM. A statistical shape model containing the left ventricle, right ventricle, left atrium, right atrium, and aorta was derived from computed tomography angiography (CTA) segmentations by principal component analysis. ASMs of the whole heart and individual cavities were generated and consecutively fitted to tissue probability maps. First, an average whole-heart model was aligned with the 3-D TEE based on three manually indicated anatomical landmarks. Second, pose and shape of the whole-heart ASM were fitted by a weighted update scheme excluding parts outside of the image sector. Third, pose and shape of ASM for individual heart cavities were initialized by the previous whole heart ASM and updated in a regularized manner to fit the tissue probability maps. The ASM segmentations were validated against manual outlines by two observers and CTA derived segmentations.

Comprehensive visualization of multimodal cardiac imaging data for assessment of coronary artery disease: first clinical results of the SMARTVis tool.

PurposeIn clinical practice, both coronary anatomy and myocardial perfusion information are needed to assess coronary artery disease (CAD). The extent and severity of coronary stenoses can be determined using computed tomography coronary angiography (CTCA); the presence and amount of ischemia can be identified using myocardial perfusion imaging, such as perfusion magnetic resonance imaging (PMR). To determine which specific stenosis is associated with which ischemic region, experts use assumptions on coronary perfusion territories. Due to the high variability between patient’s coronary artery anatomies, as well as the uncertain relation between perfusion territories and supplying coronary arteries, patient-specific systems are needed.Material and methodsWe present a patient-specific visualization system, called Synchronized Multimodal heART Visualization (SMARTVis), for relating coronary stenoses and perfusion deficits derived from CTCA and PMR, respectively. The system consists of the following comprehensive components: (1) two or three-dimensional fusion of anatomical and functional information, (2) automatic detection and ranking of coronary stenoses, (3) estimation of patient-specific coronary perfusion territories.ResultsThe potential benefits of the SMARTVis tool in assessing CAD were investigated through a case-study evaluation (conventional vs. SMARTVis tool): two experts analyzed four cases of patients with suspected multivessel coronary artery disease. When using the SMARTVis tool, a more reliable estimation of the relation between perfusion deficits and stenoses led to a more accurate diagnosis, as well as a better interobserver diagnosis agreement.ConclusionThe SMARTVis comprehensive visualization system can be effectively used to assess disease status in multivessel CAD patients, offering valuable new options for the diagnosis and management of these patients.

Additional Diagnostic Value of Integrated Analysis of Cardiac CTA and SPECT MPI Using the SMARTVis System in Patients with Suspected Coronary Artery Disease

CT angiography (CTA) and SPECT myocardial perfusion imaging (MPI) are complementary imaging techniques to assess coronary artery disease (CAD). Spatial integration and combined visualization of SPECT MPI and CTA data may facilitate correlation of myocardial perfusion defects and subtending coronary arteries and thus offer additional diagnostic value over either stand-alone or side-by-side interpretation of the respective datasets from the 2 modalities. In this study, we investigated the additional diagnostic value of a software-based CTA/SPECT MPI image fusion system over conventional side-by-side analysis in patients with suspected CAD. Methods: Seventeen symptomatic patients who underwent both CTA and SPECT MPI within a 90-d period were included in our study; 7 of them also underwent invasive coronary angiography (ICA). The potential benefits of the synchronized multimodal heart visualization (SMARTVis) system in assessing CAD were investigated through a case study involving 4 experts from 2 medical centers, in which we performed, first, a side-by-side analysis using structured CTA and SPECT reports and, second, an integrated analysis using the SMARTVis system in addition to the reports. Results: The fused interpretation led to a more accurate diagnosis, reflected in an increase in the individual observers’ sensitivity and specificity to correctly refer for invasive angiography eventually followed by revascularization. For the first, second, third, and fourth observers, the respective sensitivities improved from 50%, 60%, 80%, and 80% to 70%, 80%, 100%, and 90% and the respective specificities from 100%, 94%, 83%, and 83% to 100%, 100%, 94%, and 83%. Additionally, the interobserver diagnosis agreement increased from 74% to 84%. The improvement was primarily found in patients presenting with CAD in more vessels than the number of reported perfusion defects. Conclusion: Integrated analysis of cardiac CTA and SPECT MPI using the SMARTVis system results in an improved diagnostic performance.

Interactive contour delineation of organs at risk in radiotherapy: Clinical evaluation on NSCLC patients

PURPOSE Accurate delineation of organs at risk (OARs) on computed tomography (CT) image is required for radiation treatment planning (RTP). Manual delineation of OARs being time consuming and prone to high interobserver variability, many (semi-) automatic methods have been proposed. However, most of them are specific to a particular OAR. Here, an interactive computer-assisted system able to segment various OARs required for thoracic radiation therapy is introduced. METHODS Segmentation information (foreground and background seeds) is interactively added by the user in any of the three main orthogonal views of the CT volume and is subsequently propagated within the whole volume. The proposed method is based on the combination of watershed transformation and graph-cuts algorithm, which is used as a powerful optimization technique to minimize the energy function. The OARs considered for thoracic radiation therapy are the lungs, spinal cord, trachea, proximal bronchus tree, heart, and esophagus. The method was evaluated on multivendor CT datasets of 30 patients. Two radiation oncologists participated in the study and manual delineations from the original RTP were used as ground truth for evaluation. RESULTS Delineation of the OARs obtained with the minimally interactive approach was approved to be usable for RTP in nearly 90% of the cases, excluding the esophagus, which segmentation was mostly rejected, thus leading to a gain of time ranging from 50% to 80% in RTP. Considering exclusively accepted cases, overall OARs, a Dice similarity coefficient higher than 0.7 and a Hausdorff distance below 10 mm with respect to the ground truth were achieved. In addition, the interobserver analysis did not highlight any statistically significant difference, at the exception of the segmentation of the heart, in terms of Hausdorff distance and volume difference. CONCLUSIONS An interactive, accurate, fast, and easy-to-use computer-assisted system able to segment various OARs required for thoracic radiation therapy has been presented and clinically evaluated. The introduction of the proposed system in clinical routine may offer valuable new option to radiation oncologists in performing RTP.