Neal R. Harvey

Comparison of GENIE and conventional supervised classifiers for multispectral image feature extraction

The authors have developed an automated feature detection/classification system, called GENetic Imagery Exploitation (GENIE), which has been designed to generate image processing pipelines for a variety of feature detection/classification tasks. GENIE is a hybrid evolutionary algorithm that addresses the general problem of finding features of interest in multispectral remotely-sensed images. The authors describe their system in detail together with experiments involving comparisons of GENIE with several conventional supervised classification techniques, for a number of classification tasks using multispectral remotely sensed imagery.

USING BLOCKS OF SKEWERS FOR FASTER COMPUTATION OF PIXEL PURITY INDEX

The “pixel purity index” (PPI) algorithm proposed by Boardman, et al1 identifies potential endmember pixels in multispectral imagery. The algorithm generates a large number of “skewers” (unit vectors in random directions), and then computes the dot product of each skewer with each pixel. The PPI is incremented for those pixels associated with the extreme values of the dot products. A small number of pixels (a subset of those with the largest PPI values) are selected as “pure” and the rest of the pixels in the image are expressed as linear mixtures of these pure endmembers. This provides a convenient and physically-motivated decomposition of the image in terms of a relatively few components. We report on a variant of the PPI algorithm in which blocks of B skewers are considered at a time. Prom the computation of B dot products, one can produce a much larger set of “derived” dot products that are associated with skewers that are linear combinations of the original B skewers. Since the derived dot products involve only scalar operations, instead of full vector dot products, they can be very cheaply computed. We will also discuss a hardware implementation on a field programmable gate array (FPGA) processor both of the original PPI algorithm and of the block-skewer approach. We will furthermore discuss the use of fast PPI as a front-end to more sophisticated algorithms for selecting the actual endmembers.

Finding Golf Courses: The Ultra High Tech Approach

The search for a suitable golf course is a very important issue in the travel plans of any modern manager. Modern management is also infamous for its penchant for high-tech gadgetry. Here we combine these two facets of modern management life. We aim to provide the cutting-edge manager with a method of finding golf courses from space! In this paper, we present GENIE: a hybrid evolutionary algorithm-based system that tackles the general problem of finding features of interest in multi-spectral remotely-sensed images, including, but not limited to, golf courses. Using this system we are able to successfully locate golf courses in 10-channel satellite images of several desirable US locations.

Detection of malignancy in cytology specimens using spectral-spatial analysis

Despite low sensitivity (around 60%), cytomorphologic examination of urine specimens represents the standard procedure in the diagnosis and follow-up of bladder cancer. Although color is information-rich, morphologic diagnoses are rendered almost exclusively on the basis of spatial information. We hypothesized that quantitative assessment of color (more precisely, of spectral properties) using liquid crystal-based spectral fractionation, combined with genetic algorithm-based spatial analysis, can improve the accuracy of traditional cytologic examination. Images of various cytological specimens were collected every 10 nm from 400 to 700 nm to create an image stack. The resulting data sets were analyzed using the Los Alamos-developed GENetic Imagery Exploitation (GENIE) package, a hybrid genetic algorithm that segments (classifies) images using automatically ‘learned’ spatio-spectral features. In an evolutionary fashion, GENIE generates a series of algorithms or ‘chromosomes’, keeping the one with best fitness with respect to a user-defined training set. First, we tested the system to determine if it could recognize malignant cells using artificial cytology specimens constructed to completely avoid the requirement for human interpretation. GENIE was able to differentiate malignant from benign cells and to estimate their relative proportions in controlled mixtures. We then tested the system on routine cytology specimens. When targeted to detect malignant urothelial cells in cytology specimens, GENIE showed a combined sensitivity and specificity of 85 and 95%, in samples drawn from two separate institutions over a span of 4 years. When trained on cases initially diagnosed as ‘atypical’ but with unequivocal follow-up by biopsy, surgical specimen or cytology, GENIE showed efficiency superior to the cytopathologist with respect to predicting the follow-up result in a cohort of 85 cases. We believe that, in future, this type of methodology could be used as an ancillary test in cytopathology, in a manner analogous to immunostaining, in those situations when a definitive diagnosis cannot be rendered based solely on the morphology.

Genetic algorithm for combining new and existing image processing tools for multispectral imagery

We describe the implementation and performance of a genetic algorithm (GA) which evolves and combines image processing tools for multispectral imagery (MSI) datasets. Existing algorithms for particular features can also be “re-tuned” and combined with the newly evolved image processing tools to rapidly produce customized feature extraction tools. First results from our software system were presented previously. We now report on work extending our system to look for a range of broad-area features in MSI datasets. These features demand an integrated spatio- spectral approach, which our system is designed to use. We describe our chromosomal representation of candidate image processing algorithms, and discuss our set of image operators. Our application has been geospatial feature extraction using publicly available MSI and hyperspectral imagery (HSI). We demonstrate our system on NASA/Jet Propulsion Laboratory’s Airborne Visible and Infrared Imaging Spectrometer (AVIRIS) HSI which has been processed to simulate MSI data from the Department of Energy’s Multispectral Thermal Imager (MTI) instrument. We exhibit some of our evolved algorithms, and discuss their operation and performance.

Investigation of image feature extraction by a genetic algorithm

We describe the implementation and performance of a genetic algorithm which generates image feature extraction algorithms for remote sensing applications. We describe our basis set of primitive image operators and present our chromosomal representation of a complete algorithm. Our initial application has been geospatial feature extraction using publicly available multi-spectral aerial-photography data sets. We present the preliminary results of our analysis of the efficiency of the classic genetic operations of crossover and mutation for our application, and discuss our choice of evolutionary control parameters. We exhibit some of our evolved algorithms, and discuss possible avenues for future progress.

A reconfigurable computing framework for multi-scale cellular image processing

Cellular computing architectures represent an important class of computation that are characterized by simple processing elements, local interconnect and massive parallelism. These architectures are a good match for many image and video processing applications and can be substantially accelerated with Reconfigurable Computers. We present a flexible software/hardware framework for design, implementation and automatic synthesis of cellular image processing algorithms. The system provides an extremely flexible set of parallel, pipelined and time-multiplexed components which can be tailored through reconfigurable hardware for particular applications. The most novel aspects of our framework include a highly pipelined architecture for multi-scale cellular image processing as well as support for several different pattern recognition applications. In this paper, we will describe the system in detail and present our performance assessments. The system achieved speed-up of at least 100x for computationally expensive sub-problems and 10x for end-to-end applications compared to software implementations.

Evolving forest fire burn severity classification algorithms for multi-spectral imagery

Between May 6 and May 18, 2000, the Cerro Grande/Los Alamos wildfire burned approximately 43,000 acres (17,500 ha) and 235 residences in the town of Los Alamos, NM. Initial estimates of forest damage included 17,000 acres (6,900 ha) of 70-100% tree mortality. Restoration efforts following the fire were complicated by the large scale of the fire, and by the presence of extensive natural and man-made hazards. These conditions forced a reliance on remote sensing techniques for mapping and classifying the burn region. During and after the fire, remote-sensing data was acquired from a variety of aircraft-based and satellite-based sensors, including Landsat 7. We now report on the application of a machine learning technique, implemented in a software package called GENIE, to the classification of forest fire burn severity using Landsat 7 ETM+ multispectral imagery. The details of this automatic classification are compared to the manually produced burn classification, which was derived from field observations and manual interpretation of high-resolution aerial color/infrared photography.

Genie Pro: robust image classification using shape, texture, and spectral information

We present Genie Pro, a new software tool for image analysis produced by the ISIS (Intelligent Search in Images and Signals) group at Los Alamos National Laboratory. Like the earlier GENIE tool produced by the same group, Genie Pro is a general purpose adaptive tool that derives automatic pixel classification algorithms for satellite/aerial imagery, from training input provided by a human expert. Genie Pro is a complete rewrite of our earlier work that incorporates many new ideas and concepts. In particular, the new software integrates spectral information; and spatial cues such as texture, local morphology and large-scale shape information; in a much more sophisticated way. In addition, attention has been paid to how the human expert interacts with the software: Genie Pro facilitates highly efficient training through an interactive and iterative “training dialog”. Finally, the new software runs on both Linux and Windows platforms, increasing its versatility. We give detailed descriptions of the new techniques and ideas in Genie Pro, and summarize the results of a recent evaluation of the software.

Feature extraction from multiple data sources using genetic programming

Feature extraction from imagery is an important and long-standing problem in remote sensing. In this paper, we report on work using genetic programming to perform feature extraction simultaneously from multispectral and digital elevation model (DEM) data. We use the GENetic Imagery Exploitation (GENIE) software for this purpose, which produces image-processing software that inherently combines spatial and spectral processing. GENIE is particularly useful in exploratory studies of imagery, such as one often does in combining data from multiple sources. The user trains the software by painting the feature of interest with a simple graphical user interface. GENIE then uses genetic programming techniques to produce an image-processing pipeline. Here, we demonstrate evolution of image processing algorithms that extract a range of land cover features including towns, wildfire burnscars, and forest. We use imagery from the DOE/NNSA Multispectral Thermal Imager (MTI) spacecraft, fused with USGS 1:24000 scale DEM data.