Jiantao Pu

Adaptive Border Marching Algorithm: Automatic Lung Segmentation on Chest CT Images

Segmentation of the lungs in chest-computed tomography (CT) is often performed as a preprocessing step in lung imaging. This task is complicated especially in presence of disease. This paper presents a lung segmentation algorithm called adaptive border marching (ABM). Its novelty lies in the fact that it smoothes the lung border in a geometric way and can be used to reliably include juxtapleural nodules while minimizing oversegmentation of adjacent regions such as the abdomen and mediastinum. Our experiments using 20 datasets demonstrate that this computational geometry algorithm can re-include all juxtapleural nodules and achieve an average oversegmentation ratio of 0.43% and an average under-segmentation ratio of 1.63% relative to an expert determined reference standard. The segmentation time of a typical case is under 1min on a typical PC. As compared to other available methods, ABM is more robust, more efficient and more straightforward to implement, and once the chest CT images are input, there is no further interaction needed from users. The clinical impact of this method is in potentially avoiding false negative CAD findings due to juxtapleural nodules and improving volumetry and doubling time accuracy.

On visual similarity based 2D drawing retrieval

A large amount of 2D drawings have been produced in engineering fields. To reuse and share the available drawings efficiently, we propose two methods in this paper, namely 2.5D spherical harmonics transformation and 2D shape histogram, to retrieve 2D drawings by measuring their shape similarity. The first approach represents a drawing as a spherical function by transforming it from a 2D space into a 3D space. Then a fast spherical harmonics transformation is employed to get a rotation invariant descriptor. The second statistics-based approach represents the shape of a 2D drawing using a distance distribution between two randomly sampled points. To allow users to interactively emphasize certain local shapes that they are interested in, we have adopted a flexible sampling strategy by specifying a bias sampling density upon these local shapes. The two proposed methods have many valuable properties, including transform invariance, efficiency, and robustness. In addition, their insensitivity to noise allows for the users causal input, thus supporting a freehand sketch-based retrieval user interface. Experiments show that a better performance can be achieved by combining them together using weights.

A Computational Geometry Approach to Automated Pulmonary Fissure Segmentation in CT Examinations

Identification of pulmonary fissures, which form the boundaries between the lobes in the lungs, may be useful during clinical interpretation of computed tomography (CT) examinations to assess the early presence and characterization of manifestation of several lung diseases. Motivated by the unique nature of the surface shape of pulmonary fissures in 3-D space, we developed a new automated scheme using computational geometry methods to detect and segment fissures depicted on CT images. After a geometric modeling of the lung volume using the marching cubes algorithm, Laplacian smoothing is applied iteratively to enhance pulmonary fissures by depressing nonfissure structures while smoothing the surfaces of lung fissures. Next, an extended Gaussian image based procedure is used to locate the fissures in a statistical manner that approximates the fissures using a set of plane ldquopatchesrdquo. This approach has several advantages such as independence of anatomic knowledge of the lung structure except the surface shape of fissures, limited sensitivity to other lung structures, and ease of implementation. The scheme performance was evaluated by two experienced thoracic radiologists using a set of 100 images (slices) randomly selected from 10 screening CT examinations. In this preliminary evaluation 98.7% and 94.9% of scheme segmented fissure voxels are within 2 mm of the fissures marked independently by two radiologists in the testing image dataset. Using the scheme detected fissures as reference, 89.4% and 90.1% of manually marked fissure points have distance les2 mm to the reference suggesting a possible under-segmentation of the scheme. The case-based root mean square (rms) distances (ldquoerrorsrdquo) between our scheme and the radiologist ranged from 1.48plusmn0.92 to 2.04plusmn3.88 mm. The discrepancy of fissure detection results between the automated scheme and either radiologist is smaller in this dataset than the interreader variability.

Pulmonary Lobe Segmentation in CT Examinations Using Implicit Surface Fitting

Lobe identification in computed tomography (CT) examinations is often an important consideration during the diagnostic process as well as during treatment planning because of their relative independence of each other in terms of anatomy and function. In this paper, we present a new automated scheme for segmenting lung lobes depicted on 3-D CT examinations. The unique characteristic of this scheme is the representation of fissures in the form of implicit functions using radial basis functions (RBFs), capable of seamlessly interpolating ldquoholesrdquo in the detected fissures and smoothly extrapolating the fissure surfaces to the lung boundaries resulting in a ldquonaturalrdquo segmentation of lung lobes. A previously developed statistically based approach is used to detect pulmonary fissures and the constraint points for implicit surface fitting are selected from detected fissure surfaces in a greedy manner to improve fitting efficiency. In a preliminary assessment study, lobe segmentation results of 65 chest CT examinations, five of which were reconstructed with three section thicknesses of 0.625 mm, 1.25 mm, and 2.5 mm, were subjectively and independently evaluated by two experienced chest radiologists using a five category rating scale (i.e., excellent, good, fair, poor, and unacceptable). Thirty-three of 65 examinations (50.8%) with a section thickness of 0.625 mm were rated as either ldquoexcellentrdquo or ldquogoodrdquo by both radiologists and only one case (1.5%) was rated by both radiologists as ldquopoorrdquo or ldquounacceptable.rdquo Comparable performance was obtained with a slice thickness of 1.25 mm, but substantial performance deterioration occurred in examinations with a section thickness of 2.5 mm. The advantages of this scheme are its full automation, relative insensitivity to fissure completeness, and ease of implementation.

A 2D Sketch-Based User Interface for 3D CAD Model Retrieval

AbstractThis paper describes a sketch user interface enhanced by feedback for 3D CAD model retrieval. Users can express their intent by sketching 2D shape in the way as engineers draw three views of 3D models. It not only supports users’ free form sketches, but also accepts users’ further editing operations and feedbacks. The interaction paradigm proposed in this paper is supported by a 3D shape matching method, in which three problems are solved: determination of projecting planes and directions, 2D view generation, and similarity measuring between views. In addition, experiments are conducted to evaluate the performance of this sketch user interface by 3D model retrieval.

Shape “Break-and-Repair” Strategy and Its Application to Automated Medical Image Segmentation

In three-dimensional medical imaging, segmentation of specific anatomy structure is often a preprocessing step for computer-aided detection/diagnosis (CAD) purposes, and its performance has a significant impact on diagnosis of diseases as well as objective quantitative assessment of therapeutic efficacy. However, the existence of various diseases, image noise or artifacts, and individual anatomical variety generally impose a challenge for accurate segmentation of specific structures. To address these problems, a shape analysis strategy termed “break-and-repair” is presented in this study to facilitate automated medical image segmentation. Similar to surface approximation using a limited number of control points, the basic idea is to remove problematic regions and then estimate a smooth and complete surface shape by representing the remaining regions with high fidelity as an implicit function. The innovation of this shape analysis strategy is the capability of solving challenging medical image segmentation problems in a unified framework, regardless of the variability of anatomical structures in question. In our implementation, principal curvature analysis is used to identify and remove the problematic regions and radial basis function (RBF) based implicit surface fitting is used to achieve a closed (or complete) surface boundary. The feasibility and performance of this strategy are demonstrated by applying it to automated segmentation of two completely different anatomical structures depicted on CT examinations, namely human lungs and pulmonary nodules. Our quantitative experiments on a large number of clinical CT examinations collected from different sources demonstrate the accuracy, robustness, and generality of the shape “break-and-repair” strategy in medical image segmentation.

A Differential Geometric Approach to Automated Segmentation of Human Airway Tree

Airway diseases are frequently associated with morphological changes that may affect the physiology of the lungs. Accurate characterization of airways may be useful for quantitatively assessing prognosis and for monitoring therapeutic efficacy. The information gained may also provide insight into the underlying mechanisms of various lung diseases. We developed a computerized scheme to automatically segment the 3-D human airway tree depicted on computed tomography (CT) images. The method takes advantage of both principal curvatures and principal directions in differentiating airways from other tissues in geometric space. A “puzzle game” procedure is used to identify false negative regions and reduce false positive regions that do not meet the shape analysis criteria. The negative impact of partial volume effects on small airway detection is partially alleviated by repeating the developed differential geometric analysis on lung anatomical structures modeled at multiple iso-values (thresholds). In addition to having advantages, such as full automation, easy implementation and relative insensitivity to image noise and/or artifacts, this scheme has virtually no leakage issues and can be easily extended to the extraction or the segmentation of other tubular type structures (e.g., vascular tree). The performance of this scheme was assessed quantitatively using 75 chest CT examinations acquired on 45 subjects with different slice thicknesses and using 20 publicly available test cases that were originally designed for evaluating the performance of different airway tree segmentation algorithms.

A 3d model retrieval method using 2d freehand sketches

In this paper, a method is proposed to retrieve desired 3D models by measuring the similarity between a users freehand sketches and 2D orthogonal views generated from 3D models. The proposed method contains three parts: (1) pose determination of a 3D model; (2) 2D orthogonal view generation along the orientations; and (3) similarity measurement between a users sketches and the 2D views. Users can submit one, two or three views intuitively as a query, which are similar to the three main views in engineering drawing. It is worth pointing point out that our method only needs three views, while 13 views is the minimum set that has been reported by other researchers.

CT based computerized identification and analysis of human airways: A review

As one of the most prevalent chronic disorders, airway disease is a major cause of morbidity and mortality worldwide. In order to understand its underlying mechanisms and to enable assessment of therapeutic efficacy of a variety of possible interventions, noninvasive investigation of the airways in a large number of subjects is of great research interest. Due to its high resolution in temporal and spatial domains, computed tomography (CT) has been widely used in clinical practices for studying the normal and abnormal manifestations of lung diseases, albeit there is a need to clearly demonstrate the benefits in light of the cost and radiation dose associated with CT examinations performed for the purpose of airway analysis. Whereas a single CT examination consists of a large number of images, manually identifying airway morphological characteristics and computing features to enable thorough investigations of airway and other lung diseases is very time-consuming and susceptible to errors. Hence, automated and semiautomated computerized analysis of human airways is becoming an important research area in medical imaging. A number of computerized techniques have been developed to date for the analysis of lung airways. In this review, we present a summary of the primary methods developed for computerized analysis of human airways, including airway segmentation, airway labeling, and airway morphometry, as well as a number of computer-aided clinical applications, such as virtual bronchoscopy. Both successes and underlying limitations of these approaches are discussed, while highlighting areas that may require additional work.

Optimization of breast mass classification using sequential forward floating selection (SFFS) and a support vector machine (SVM) model

PurposeImproving radiologists’ performance in classification between malignant and benign breast lesions is important to increase cancer detection sensitivity and reduce false-positive recalls. For this purpose, developing computer-aided diagnosis schemes has been attracting research interest in recent years. In this study, we investigated a new feature selection method for the task of breast mass classification.MethodsWe initially computed 181 image features based on mass shape, spiculation, contrast, presence of fat or calcifications, texture, isodensity, and other morphological features. From this large image feature pool, we used a sequential forward floating selection (SFFS)-based feature selection method to select relevant features and analyzed their performance using a support vector machine (SVM) model trained for the classification task. On a database of 600 benign and 600 malignant mass regions of interest, we performed the study using a tenfold cross-validation method. Feature selection and optimization of the SVM parameters were conducted on the training subsets only.ResultsThe area under the receiver operating characteristic curve