Victor Murray

Multiscale AM-FM Methods for Diabetic Retinopathy Lesion Detection

In this paper, we propose the use of multiscale amplitude-modulation-frequency-modulation (AM-FM) methods for discriminating between normal and pathological retinal images. The method presented in this paper is tested using standard images from the early treatment diabetic retinopathy study. We use 120 regions of 40 × 40 pixels containing four types of lesions commonly associated with diabetic retinopathy (DR) and two types of normal retinal regions that were manually selected by a trained analyst. The region types included microaneurysms, exudates, neovascularization on the retina, hemorrhages, normal retinal background, and normal vessels patterns. The cumulative distribution functions of the instantaneous amplitude, the instantaneous frequency magnitude, and the relative instantaneous frequency angle from multiple scales are used as texture feature vectors. We use distance metrics between the extracted feature vectors to measure interstructure similarity. Our results demonstrate a statistical differentiation of normal retinal structures and pathological lesions based on AM-FM features. We further demonstrate our AM-FM methodology by applying it to classification of retinal images from the MESSIDOR database. Overall, the proposed methodology shows significant capability for use in automatic DR screening.

Multiscale AM-FM Demodulation and Image Reconstruction Methods With Improved Accuracy

We develop new multiscale amplitude-modulation frequency-modulation (AM-FM) demodulation methods for image processing. The approach is based on three basic ideas: (i) AM-FM demodulation using a new multiscale filterbank, (ii) new, accurate methods for instantaneous frequency (IF) estimation, and (iii) multiscale least squares AM-FM reconstructions. In particular, we introduce a variable-spacing local linear phase (VS-LLP) method for improved instantaneous frequency (IF) estimation and compare it to an extended quasilocal method and the quasi-eigen function approximation (QEA). It turns out that the new VS-LLP method is a generalization of the QEA method where we choose the best integer spacing between the samples to adapt as a function of frequency. We also introduce a new quasi-local method (QLM) for IF and IA estimation and discuss some of its advantages and limitations. The new IF estimation methods lead to significantly improved estimates. We present different multiscale decompositions to show that the proposed methods can be used to reconstruct and analyze general images.

Automatic detection of diabetic retinopathy and age-related macular degeneration in digital fundus images

PURPOSE To describe and evaluate the performance of an algorithm that automatically classifies images with pathologic features commonly found in diabetic retinopathy (DR) and age-related macular degeneration (AMD). METHODS Retinal digital photographs (N = 2247) of three fields of view (FOV) were obtained of the eyes of 822 patients at two centers: The Retina Institute of South Texas (RIST, San Antonio, TX) and The University of Texas Health Science Center San Antonio (UTHSCSA). Ground truth was provided for the presence of pathologic conditions, including microaneurysms, hemorrhages, exudates, neovascularization in the optic disc and elsewhere, drusen, abnormal pigmentation, and geographic atrophy. The algorithm was used to report on the presence or absence of disease. A detection threshold was applied to obtain different values of sensitivity and specificity with respect to ground truth and to construct a receiver operating characteristic (ROC) curve. RESULTS The system achieved an average area under the ROC curve (AUC) of 0.89 for detection of DR and of 0.92 for detection of sight-threatening DR (STDR). With a fixed specificity of 0.50, the systems sensitivity ranged from 0.92 for all DR cases to 1.00 for clinically significant macular edema (CSME). CONCLUSIONS A computer-aided algorithm was trained to detect different types of pathologic retinal conditions. The cases of hard exudates within 1 disc diameter (DD) of the fovea (surrogate for CSME) were detected with very high accuracy (sensitivity = 1, specificity = 0.50), whereas mild nonproliferative DR was the most challenging condition (sensitivity = 0.92, specificity = 0.50). The algorithm was also tested on images with signs of AMD, achieving a performance of AUC of 0.84 (sensitivity = 0.94, specificity = 0.50).

Multiscale Amplitude-Modulation Frequency-Modulation (AM–FM) Texture Analysis of Multiple Sclerosis in Brain MRI Images

This study introduces the use of multiscale amplitude modulation-frequency modulation (AM-FM) texture analysis of multiple sclerosis (MS) using magnetic resonance (MR) images from brain. Clinically, there is interest in identifying potential associations between lesion texture and disease progression, and in relating texture features with relevant clinical indexes, such as the expanded disability status scale (EDSS). This longitudinal study explores the application of 2-D AM-FM analysis of brain white matter MS lesions to quantify and monitor disease load. To this end, MS lesions and normal-appearing white matter (NAWM) from MS patients, as well as normal white matter (NWM) from healthy volunteers, were segmented on transverse T2-weighted images obtained from serial brain MR imaging (MRI) scans (0 and 6-12 months). The instantaneous amplitude (IA), the magnitude of the instantaneous frequency (IF), and the IF angle were extracted from each segmented region at different scales. The findings suggest that AM-FM characteristics succeed in differentiating 1) between NWM and lesions; 2) between NAWM and lesions; and 3) between NWM and NAWM. A support vector machine (SVM) classifier succeeded in differentiating between patients that, two years after the initial MRI scan, acquired an EDSS ≤ 2 from those with EDSS >; 2 (correct classification rate = 86%). The best classification results were obtained from including the combination of the low-scale IA and IF magnitude with the medium-scale IA. The AM-FM features provide complementary information to classical texture analysis features like the gray-scale median, contrast, and coarseness. The findings of this study provide evidence that AM-FM features may have a potential role as surrogate markers of lesion load in MS.

Detection of neovascularization in the optic disc using an AM-FM representation, granulometry, and vessel segmentation

Neovascularization, defined as abnormal formation of blood vessels in the retina, is a sight-threatening condition indicative of late-stage diabetic retinopathy (DR). Ischemia due to leakage of blood vessels causes the body to produce new and weak vessels that can lead to complications such as vitreous hemorrhages. Neovascularization on the disc (NVD) is diagnosed when new vessels are located within one disc-diameter of the optic disc. Accurately detecting NVD is important in preventing vision loss due to DR. This paper presents a method for detecting NVD in digital fundus images. First, a region of interest (ROI) containing the optic disc is manually selected from the image. By adaptively combining contrast enhancement methods with a vessel segmentation technique, the ROI is reduced to the regions indicated by the segmented vessels. Textural features extracted by using amplitude-modulation frequency-modulation (AM-FM) techniques and granulometry are used to differentiate NVD from a normal optic disc. Partial least squares is used to perform the final classification. Leave-one-out cross-validation was used to evaluate the performance of the system with 27 NVD and 30 normal cases. We obtained an area under the receiver operator characteristic curve (AUC) of 0.85 by using all features, increasing to 0.94 with feature selection.

Multiscale Amplitude-Modulation Frequency-Modulation (AM–FM) Texture Analysis of Ultrasound Images of the Intima and Media Layers of the Carotid Artery

The intima-media thickness (IMT) of the common carotid artery (CCA) is widely used as an early indicator of cardiovascular disease (CVD). Clinically, there is strong interest in identifying how the composition and texture of the media layer (ML) can be associated with the risk of stroke. In this study, we use 2-D amplitude-modulation frequency-modulation (AM-FM) analysis of the intima-media complex (IMC), the ML, and intima layer (IL) of the CCA to detect texture changes as a function of age and sex. The study was performed on 100 ultrasound images acquired from asymptomatic subjects at risk of atherosclerosis. To investigate texture variations associated with age, we separated them into three age groups: 1) patients younger than 50; 2) patients aged between 50 and 60 years old; and 3) patients over 60 years old. We also separated the patients by sex. The IMC, ML, and IL were segmented manually by a neurovascular expert and also by a snake-based segmentation system. To reject strong edge artifacts, we prefilter with an AM-FM filterbank that is centered along the horizontal frequency axis (parallel to the long axis of the IMC, ML, and IL), while removing the low-pass filter estimates and frequency bands with large, vertical frequency components. To investigate significant texture changes, we extract the instantaneous amplitude (IA) and the magnitude of the instantaneous frequency (IF) over each layer component, for low-, medium-, and high-frequency AM-FM components. We detected significant texture differences between the higher risk age group of >;60 years versus the lower risk age group of <;50 and the 50-60 group. In particular, between the <;50 and >;60 groups, we found significant differences in the medium-scale IA extracted from the IMC. Between the >;60 and the 50-60 groups, we found significant texture changes in the low scale IA and high-scale IF magnitude extracted from the IMC, and the low-scale IA extracted from the IL. Also, we noted that the IA for the ML showed significant differences between males and females for all age groups. The AM-FM features provide complimentary information to classical texture analysis features like the gray-scale median, contrast, and coarseness. These findings provide evidence that AM-FM texture features can be associated with the progression of cardiovascular risk for disease and the risk of stroke with age. However, a larger scale study is needed to establish the application in clinical practice.

Multi-scale AM-FM for lesion phenotyping on age-related macular degeneration

Age-related macular degeneration (AMD) is the most common cause of visual loss in the United States and is a growing public health problem. The presence and severity of AMD in current epidemiological studies is detected by the grading of color stereoscopic fundus photographs. The purpose of this study was to show that a mathematical technique, amplitude-modulation frequency modulation (AM-FM) can be used to generate multi-scale features for classifying pathological structures, such as drusen, on a retinal image. AM-FM features were calculated for N=120 40×40 regions from 5 retinal images presenting with age-related macular degeneration. The results show that with this technique, drusen can be differenced from normal retinal structures by more than three standard deviations using the AM-FM histograms. In addition, by using different color spaces highly accurate classification of structures of the retina is achieved. These results are the first step in the development of an automated AMD grading system.

A Multiscale Optimization Approach to Detect Exudates in the Macula

Pathologies that occur on or near the fovea, such as clinically significant macular edema (CSME), represent high risk for vision loss. The presence of exudates, lipid residues of serous leakage from damaged capillaries, has been associated with CSME, in particular if they are located one optic disc-diameter away from the fovea. In this paper, we present an automatic system to detect exudates in the macula. Our approach uses optimal thresholding of instantaneous amplitude (IA) components that are extracted from multiple frequency scales to generate candidate exudate regions. For each candidate region, we extract color, shape, and texture features that are used for classification. Classification is performed using partial least squares (PLS). We tested the performance of the system on two different databases of 652 and 400 images. The system achieved an area under the receiver operator characteristic curve (AUC) of 0.96 for the combination of both databases and an AUC of 0.97 for each of them when they were evaluated independently.

An AM-FM model for Motion Estimation in Atherosclerotic Plaque Videos

We present new multidimensional amplitude-modulation frequency-modulation (AM-FM) methods for motion estimation. For a single AM-FM component we show that the optical flow constraint leads to separate equations for amplitude modulation (AM) and frequency modulation (FM). We compare our approach with phase-based estimation developed by Fleet and Jepson and also the original optical flow method by Horn and Schunck. An advantage of the proposed method is that it provides for dense estimates that remain accurate over the entire video. We also present preliminary results on atherosclerotic plaques videos where the AM method appears to work best.

Automatic system for diabetic retinopathy screening based on AM-FM, partial least squares, and support vector machines

Diabetic retinopathy (DR) is a disease that affects over 170 million people worldwide. In the United States, it is estimated that over 10 million diabetics do not receive the recommended annual eye examinations, significantly increasing their risk of vision loss. In this paper we present an automatic system to detect the presence of DR by analyzing a photograph of the central field of the retina. The system applies Amplitude Modulation-Frequency Modulation (AM-FM) for feature extraction, and partial least squares (PLS) and support vector machines (SVM) for classification. We tested the system on a total of 400 images, and obtained an area under the ROC curve (AUC) of 0.86, and corresponding sensitivity/specificity of 98%/68%. We also tested the accuracy of the system for patients needing immediate referral to a specialist, obtaining an AUC of 0.98.