Wu Qiu

Prostate Segmentation: An Efficient Convex Optimization Approach With Axial Symmetry Using 3-D TRUS and MR Images

We propose a novel global optimization-based approach to segmentation of 3-D prostate transrectal ultrasound (TRUS) and T2 weighted magnetic resonance (MR) images, enforcing inherent axial symmetry of prostate shapes to simultaneously adjust a series of 2-D slice-wise segmentations in a “global” 3-D sense. We show that the introduced challenging combinatorial optimization problem can be solved globally and exactly by means of convex relaxation. In this regard, we propose a novel coherent continuous max-flow model (CCMFM), which derives a new and efficient duality-based algorithm, leading to a GPU-based implementation to achieve high computational speeds. Experiments with 25 3-D TRUS images and 30 3-D T2w MR images from our dataset, and 50 3-D T2w MR images from a public dataset, demonstrate that the proposed approach can segment a 3-D prostate TRUS/MR image within 5-6 s including 4-5 s for initialization, yielding a mean Dice similarity coefficient of 93.2% ± 2.0% for 3-D TRUS images and 88.5% ± 3.5% for 3-D MR images. The proposed method also yields relatively low intra- and inter-observer variability introduced by user manual initialization, suggesting a high reproducibility, independent of observers.

3-D Carotid Multi-Region MRI Segmentation by Globally Optimal Evolution of Coupled Surfaces

In this paper, we propose a novel global optimization based 3-D multi-region segmentation algorithm for T1-weighted black-blood carotid magnetic resonance (MR) images. The proposed algorithm partitions a 3-D carotid MR image into three regions: wall, lumen, and background. The algorithm performs such partitioning by simultaneously evolving two coupled 3-D surfaces of carotid artery adventitia boundary (AB) and lumen-intima boundary (LIB) while preserving their anatomical inter-surface consistency such that the LIB is always located within the AB. In particular, we show that the proposed algorithm results in a fully time implicit scheme that propagates the two linearly ordered surfaces of the AB and LIB to their globally optimal positions during each discrete time frame by convex relaxation. In this regard, we introduce the continuous max-flow model and prove its duality/equivalence to the convex relaxed optimization problem with respect to each evolution step. We then propose a fully parallelized continuous max-flow-based algorithm, which can be readily implemented on a GPU to achieve high computational efficiency. Extensive experiments, with four users using 12 3T MR and 26 1.5T MR images, demonstrate that the proposed algorithm yields high accuracy and low operator variability in computing vessel wall volume. In addition, we show the algorithm outperforms previous methods in terms of high computational efficiency and robustness with fewer user interactions.

Needle Segmentation Using 3D Quick Randomized Hough Transform

A quick 3D needle segmentation algorithm for 3D US data is described in this paper. The algorithm includes the 3D quick randomized Hough transform (3DGHT), which is based on the 3D randomized Hough transform and coarse-fine searching strategy. We tested it with water phantom. The results show that our algorithm works well in 3D US images with angular deviation less than 1 degree and position deviation less than 1 mm, and the computational time of segmentation with 35 MB data is within 1s.

Efficient Convex Optimization Approach to 3D Non-rigid MR-TRUS Registration

In this study, we propose an efficient non-rigid MR-TRUS deformable registration method to improve the accuracy of targeting suspicious locations during a 3D ultrasound (US) guided prostate biopsy. The proposed deformable registration approach employs the multi-channel modality independent neighbourhood descriptor (MIND) as the local similarity feature across the two modalities of MR and TRUS, and a novel and efficient duality-based convex optimization based algorithmic scheme is introduced to extract the deformations which align the two MIND descriptors. The registration accuracy was evaluated using 10 patient images by measuring the TRE of manually identified corresponding intrinsic fiducials in the whole gland and peripheral zone, and performance metrics (DSC, MAD and MAXD) for the apex, mid-gland and base of the prostate were also calculated by comparing two manually segmented prostate surfaces in the registered 3D MR and TRUS images. Experimental results show that the proposed method yielded an overall mean TRE of 1.74 mm, which is favorably comparable to a clinical requirement for an error of less than 2.5 mm.

Rotational-Slice-Based prostate segmentation using level set with shape constraint for 3d end-firing TRUS guided biopsy

Prostate segmentation in 3D ultrasound images is an important step in the planning and treatment of 3D end-firing transrectal ultrasound (TRUS) guided prostate biopsy. A semi-automatic prostate segmentation method is presented in this paper, which integrates a modified distance regularization level set formulation with shape constraint to a rotational-slice-based 3D prostate segmentation method. Its performance, using different metrics, has been evaluated on a set of twenty 3D patient prostate images by comparison with expert delineations. The volume overlap ratio of 93.39 +/- 1.26% and the mean absolute surface distance of 1.16 +/- 0.34 mm were found in the quantitative validation result.

Dual optimization based prostate zonal segmentation in 3D MR images

Efficient and accurate segmentation of the prostate and two of its clinically meaningful sub-regions: the central gland (CG) and peripheral zone (PZ), from 3D MR images, is of great interest in image-guided prostate interventions and diagnosis of prostate cancer. In this work, a novel multi-region segmentation approach is proposed to simultaneously segment the prostate and its two major sub-regions from only a single 3D T2-weighted (T2w) MR image, which makes use of the prior spatial region consistency and incorporates a customized prostate appearance model into the segmentation task. The formulated challenging combinatorial optimization problem is solved by means of convex relaxation, for which a novel spatially continuous max-flow model is introduced as the dual optimization formulation to the studied convex relaxed optimization problem with region consistency constraints. The proposed continuous max-flow model derives an efficient duality-based algorithm that enjoys numerical advantages and can be easily implemented on GPUs. The proposed approach was validated using 18 3D prostate T2w MR images with a body-coil and 25 images with an endo-rectal coil. Experimental results demonstrate that the proposed method is capable of efficiently and accurately extracting both the prostate zones: CG and PZ, and the whole prostate gland from the input 3D prostate MR images, with a mean Dice similarity coefficient (DSC) of 89.3±3.2% for the whole gland (WG), 82.2±3.0% for the CG, and 69.1±6.9% for the PZ in 3D body-coil MR images; 89.2±3.3% for the WG, 83.0±2.4% for the CG, and 70.0±6.5% for the PZ in 3D endo-rectal coil MR images. In addition, the experiments of intra- and inter-observer variability introduced by user initialization indicate a good reproducibility of the proposed approach in terms of volume difference (VD) and coefficient-of-variation (CV) of DSC.

Needle segmentation using 3D Hough transform in 3D TRUS guided prostate transperineal therapy.

PURPOSE Prostate adenocarcinoma is the most common noncutaneous malignancy in American men with over 200,000 new cases diagnosed each year. Prostate interventional therapy, such as cryotherapy and brachytherapy, is an effective treatment for prostate cancer. Its success relies on the correct needle implant position. This paper proposes a robust and efficient needle segmentation method, which acts as an aid to localize the needle in three-dimensional (3D) transrectal ultrasound (TRUS) guided prostate therapy. METHODS The procedure of locating the needle in a 3D TRUS image is a three-step process. First, the original 3D ultrasound image containing a needle is cropped; the cropped image is then converted to a binary format based on its histogram. Second, a 3D Hough transform based needle segmentation method is applied to the 3D binary image in order to locate the needle axis. The position of the needle endpoint is finally determined by an optimal threshold based analysis of the intensity probability distribution. The overall efficiency is improved through implementing a coarse-fine searching strategy. The proposed method was validated in tissue-mimicking agar phantoms, chicken breast phantoms, and 3D TRUS patient images from prostate brachytherapy and cryotherapy procedures by comparison to the manual segmentation. The robustness of the proposed approach was tested by means of varying parameters such as needle insertion angle, needle insertion length, binarization threshold level, and cropping size. RESULTS The validation results indicate that the proposed Hough transform based method is accurate and robust, with an achieved endpoint localization accuracy of 0.5 mm for agar phantom images, 0.7 mm for chicken breast phantom images, and 1 mm for in vivo patient cryotherapy and brachytherapy images. The mean execution time of needle segmentation algorithm was 2 s for a 3D TRUS image with size of 264 × 376 × 630 voxels. CONCLUSIONS The proposed needle segmentation algorithm is accurate, robust, and suitable for 3D TRUS guided prostate transperineal therapy.

Hierarchical max-flow segmentation framework for multi-atlas segmentation with Kohonen self-organizing map based Gaussian mixture modeling

The incorporation of intensity, spatial, and topological information into large-scale multi-region segmentation has been a topic of ongoing research in medical image analysis. Multi-region segmentation problems, such as segmentation of brain structures, pose unique challenges in image segmentation in which regions may not have a defined intensity, spatial, or topological distinction, but rely on a combination of the three. We propose a novel framework within the Advanced segmentation tools (ASETS)(2), which combines large-scale Gaussian mixture models trained via Kohonen self-organizing maps, with deformable registration, and a convex max-flow optimization algorithm incorporating region topology as a hierarchy or tree. Our framework is validated on two publicly available neuroimaging datasets, the OASIS and MRBrainS13 databases, against the more conventional Potts model, achieving more accurate segmentations. Each component is accelerated using general-purpose programming on graphics processing Units to ensure computational feasibility.

Three-Dimensional Nonrigid MR-TRUS Registration Using Dual Optimization

In this study, we proposed an efficient nonrigid magnetic resonance (MR) to transrectal ultrasound (TRUS) deformable registration method in order to improve the accuracy of targeting suspicious regions during a three dimensional (3-D) TRUS guided prostate biopsy. The proposed deformable registration approach employs the multi-channel modality independent neighborhood descriptor (MIND) as the local similarity feature across the two modalities of MR and TRUS, and a novel and efficient duality-based convex optimization-based algorithmic scheme was introduced to extract the deformations and align the two MIND descriptors. The registration accuracy was evaluated using 20 patient images by calculating the TRE using manually identified corresponding intrinsic fiducials in the whole gland and peripheral zone. Additional performance metrics [Dice similarity coefficient (DSC), mean absolute surface distance (MAD), and maximum absolute surface distance (MAXD)] were also calculated by comparing the MR and TRUS manually segmented prostate surfaces in the registered images. Experimental results showed that the proposed method yielded an overall median TRE of 1.76 mm. The results obtained in terms of DSC showed an average of 80.8±7.8% for the apex of the prostate, 92.0±3.4% for the mid-gland, 81.7±6.4% for the base and 85.7±4.7% for the whole gland. The surface distance calculations showed an overall average of 1.84±0.52 mm for MAD and 6.90±2.07 mm for MAXD.

Automatic segmentation approach to extracting neonatal cerebral ventricles from 3D ultrasound images.

&NA; Preterm neonates with a very low birth weight of less than 1,500 g are at increased risk for developing intraventricular hemorrhage (IVH). Progressive ventricle dilatation of IVH patients may cause increased intracranial pressure, leading to neurological damage, such as neurodevelopmental delay and cerebral palsy. The technique of 3D ultrasound (US) imaging has been used to quantitatively monitor the ventricular volume in IVH neonates, which may elucidate the ambiguity surrounding the timing of interventions in these patients as 2D clinical US imaging relies on linear measurement and visual estimation of ventricular dilation from a series of 2D slices. To translate 3D US imaging into the clinical setting, a fully automated segmentation algorithm is necessary to extract the ventricular system from 3D neonatal brain US images. In this paper, an automatic segmentation approach is proposed to delineate lateral ventricles of preterm neonates from 3D US images. The proposed segmentation approach makes use of phase congruency map, multi‐atlas initialization technique, atlas selection strategy, and a multiphase geodesic level‐sets (MGLS) evolution combined with a spatial shape prior derived from multiple pre‐segmented atlases. Experimental results using 30 IVH patient images show that the proposed GPU‐implemented approach is accurate in terms of the Dice similarity coefficient (DSC), the mean absolute surface distance (MAD), and maximum absolute surface distance (MAXD). To the best of our knowledge, this paper reports the first study on automatic segmentation of the ventricular system of premature neonatal brains from 3D US images. HighlightsFirst study on automatic segmentation of neonatal ventricles from 3D US images.Multi‐atlas initialized multi‐region segmentation approach.Convex optimization based minimization of the defined energy function.Parallelized GPU implementation. Graphical abstract Figure. No caption available.