Ee Ping Ong

A low-dimensional step pattern analysis algorithm with application to multimodal retinal image registration

Existing feature descriptor-based methods on retinal image registration are mainly based on scale-invariant feature transform (SIFT) or partial intensity invariant feature descriptor (PIIFD). While these descriptors are often being exploited, they do not work very well upon unhealthy multimodal images with severe diseases. Additionally, the descriptors demand high dimensionality to adequately represent the features of interest. The higher the dimensionality, the greater the consumption of resources (e.g. memory space). To this end, this paper introduces a novel registration algorithm coined low-dimensional step pattern analysis (LoSPA), tailored to achieve low dimensionality while providing sufficient distinctiveness to effectively align unhealthy multimodal image pairs. The algorithm locates hypotheses of robust corner features based on connecting edges from the edge maps, mainly formed by vascular junctions. This method is insensitive to intensity changes, and produces uniformly distributed features and high repeatability across the image domain. The algorithm continues with describing the corner features in a rotation invariant manner using step patterns. These customized step patterns are robust to non-linear intensity changes, which are well-suited for multimodal retinal image registration. Apart from its low dimensionality, the LoSPA algorithm achieves about two-fold higher success rate in multimodal registration on the dataset of severe retinal diseases when compared to the top score among state-of-the-art algorithms.

An automatic quantitative measurement method for performance assessment of retina image registration algorithms

This paper presents a novel automatic quantitative measurement method for assessment of the performance of image registration algorithms designed for registering retina fundus images. To achieve automatic quantitative measurement, we propose the use of edges and edge dissimilarity measure for determining the performance of retina image registration algorithms. Our input is the registered pair of retina fundus images obtained using any of the existing retina image registration algorithms in the literature. To compute edge dissimilarity score, we propose an edge dissimilarity measure that we called robustified Hausdorff distance. We show that our proposed approach is feasible as designed by drawing comparison to visual evaluation results when tested on images from the DRIVERA and G9 dataset.This paper presents a novel automatic quantitative measurement method for assessment of the performance of image registration algorithms designed for registering retina fundus images. To achieve automatic quantitative measurement, we propose the use of edges and edge dissimilarity measure for determining the performance of retina image registration algorithms. Our input is the registered pair of retina fundus images obtained using any of the existing retina image registration algorithms in the literature. To compute edge dissimilarity score, we propose an edge dissimilarity measure that we called “robustified Hausdorff distance”. We show that our proposed approach is feasible as designed by drawing comparison to visual evaluation results when tested on images from the DRIVERA and G9 dataset.

Geometric corner extraction in retinal fundus images

This paper presents a novel approach of finding corner features between retinal fundus images. Such images are relatively textureless and comprising uneven shades which render state-of-the-art approaches e.g., SIFT to be ineffective. Many of the detected features have low repeatability (<; 10%), especially when the viewing angle difference in the corresponding images is large. Our approach is based on the finding of blood vessels using a robust line fitting algorithm, and locating corner features based on the bends and intersections between the blood vessels. These corner features have proven to be superior to the state-of-the-art feature extraction methods (i.e. SIFT, SURF, Harris, Good Features To Track (GFTT) and FAST) with regard to repeatability and stability in our experiment. Overall in average, the approach has close to 10% more repeatable detected features than the second best in two corresponding retinal images in the experiment.

Registration of Color and OCT Fundus Images Using Low-dimensional Step Pattern Analysis

Existing feature descriptor-based methods on retinal image registration are mainly based on scale-invariant feature transform (SIFT) or partial intensity invariant feature descriptor (PIIFD). While these descriptors are many times being exploited, they have not been applied to color fundus and optical coherence tomography (OCT) fundus image pairs. OCT fundus images are challenging to register as they are often degraded by speckle noise. The descriptors also demand high dimensionality to adequately represent the features of interest. To this end, this paper presents a registration algorithm coined low-dimensional step pattern analysis (LoSPA), tailored to achieve low dimensionality while providing sufficient distinctiveness to effectively register OCT fundus images with color fundus photographs. The algorithm locates hypotheses of robust corner features based on connecting edges from the edge maps, mainly formed by vascular junctions. It continues with describing the corner features in a rotation invariant manner using step patterns. These customized step patterns are insensitive to intensity changes. We conduct comparative evaluation and LoSPA achieves a higher success rate in registration when compared to the state-of-the-art algorithms.

Retina verification using a combined points and edges approach

This paper presents a novel retina biometric scheme that performs person verification based on passing 2 stages: robust feature points matching and edge dissimilarity measure. Our approach differs from those in the literature as we propose the use of edges and edge dissimilarity measure for retina verification. Our first-stage matching/authentication utilizes robust feature points matching to determine tentatively whether there is a “match” and if so, performs image registration between the test and template retina image. The robust feature points matching is achieved in 2 steps: graph-based feature points matching followed by pruning of wrongly matched feature points using a Least-Median-Squares estimator that enforces an affine transformation geometric constraint. To compute edge dissimilarity measure in our second-stage matching/authentication, we propose the “robustified Hausdorff distance”. We show that our proposed approach outperforms two of the state-of-the-art approaches when tested on the same dataset.

An augmented reality assistance platform for eye laser surgery.

This paper presents a novel augmented reality assistance platform for eye laser surgery. The aims of the proposed system are for the application of assisting eye doctors in pre-planning as well as providing guidance and protection during laser surgery. We developed algorithms to automatically register multi-modal images, detect macula and optic disc regions, and demarcate these as protected areas from laser surgery. The doctor will then be able to plan the laser treatment pre-surgery using the registered images and segmented regions. Thereafter, during live surgery, the system will automatically register and track the slit lamp video frames on the registered retina images, send appropriate warning when the laser is near protected areas, and disable the laser function when it points into the protected areas. The proposed system prototype can help doctors to speed up laser surgery with confidence without fearing that they may unintentionally fire laser in the protected areas.

A Robust Outlier Elimination Approach for Multimodal Retina Image Registration

This paper presents a robust outlier elimination approach for multimodal retina image registration application. Our proposed scheme is based on the Scale-Invariant Feature Transform (SIFT) feature extraction and Partial Intensity Invariant Feature Descriptors (PIIFD), and we combined with a novel outlier elimination approach to robustly eliminate incorrect putative matches to achieve better registration results. Our proposed approach, which we will henceforth refer to as the residual-scaled-weighted Least Trimmed Squares (RSW-LTS) method, has been designed to enforce an affine transformation geometric constraint to solve the problem of image registration when there is very high percentage of incorrect matches in putatively matched feature points. Our experiments on registration of fundus-fluorescein angiographic image pairs show that our proposed scheme significantly outperforms the Harris-PIIFD scheme. We also show that our proposed RSW-LTS approach outperforms other outlier elimination approaches such as RANSAC (RANdom SAmple Consensus) and MSAC (M-estimator SAmple and Consensus).