Georgy Kukharev

Application of two-dimensional canonical correlation analysis for face image processing and recognition

Paper presents the method of two-dimensional canonical correlation analysis (2DCCA) applied to image processing and biometrics. Method is based on representing the image as the sets of its rows (r) and columns (c) and implementation of CCA using these sets (for this reason we named the method as CCArc). CCArc features simple implementation and lower complexity than other known approaches. In applications to biometrics CCArc is suitable to solving the problems when dimension of images (dimension of feature space) is greater than number of images, i.e. when Small Sample Size (SSS) problem exists.High efficiency of CCArc method is demonstrated for a number of computer experiments. Experiments are described by means of compact notations that simplify use of results in the framework of meta-analysis.

Methods of face photo-sketch comparison

Article presents the state of the art problem of comparing photo portrait and the corresponding hand-drawn portrait (sketch). Proposed novel methods of automatic sketch generation. The result of the application of this methods on two popular face database are given. It is shown that for sketch recognition you can use simple system.

Face recognition using two-dimensional CCA and PLS

This paper presents the implementation of the method of twodimensional Canonical Correlation Analysis (CCA) and two-dimensional Partial Least Squares (PLS) applied to image matching. Both methods are based on representing the image as the sets of its rows and columns and implementation of CCA using these sets (hence we named the methods as CCArc and PLSrc). CCArc and PLSrc feature simple implementation and lesser complexity than other known approaches. In applications to biometrics, CCArc and PLSrc are suitable to solving the problems when dimension of images (dimension of feature space) is greater than the number of images, i.e., Small Sample Size (SSS) problem. This paper demonstrates high efficiency of CCArc and PLSrc for a number of computer experiments, using benchmark image databases.

Simple and Robust Facial Portraits Recognition under Variable Lighting Conditions Based on Two-Dimensional Orthogonal Transformations

The paper addresses the problem of face recognition for images registered in variable lighting, which is common for real-world conditions. Presented algorithm is based on orthogonal transformation preceded by simple transformations comprising of equalization of brightness gradients, removal of spatial low frequency spectral components and fusion of spectral features depending on average pixels intensity. Two types of transformations: 2DDCT (two-dimensional Discrete Cosine Transform) and 2DKLT (two-dimensional Karhunen-Loeve Transform) were investigated in order to find the most optimal algorithm setup. The results of experiments conducted on Yale B and Yale B+ datasets show that a quite simple algorithm is capable of successful recognition without high computing power demand, as opposite to several more sophisticated methods presented recently.

Application of two-dimensional principal component analysis for recognition of face images

A two-dimensional principal component analysis (2D PCA) method directed at processing digital images is discussed. The method is based on representation of images as a set of rows and columns analyzing these sets. Two methods of realizing the 2D PCA corresponding to the parallel and cascade forms of its realization are presented, and their characteristics are estimated. The application of the 2D PCA method is shown for solving problems of representation and recognition of facial images. The experiments are fulfilled on ORL and FERET bases.

An Approach to Improve Accuracy of Photo–to–Sketch Matching

The problem of automatically matching sketches to facial photos is discussed. The idea presented is based on generating a population of sketches which imitates sketches generated from verbal descriptions provided by a virtual group of witnesses in forensic practice. Structures of benchmark photo–sketch databases are presented that are intended to model and implement a face photo retrieval by a given sketch. A new component of these databases is a population of sketches that represents each separate class of original photos. In this case, the original sketch is transformed into such population and then within this population we find a sketch that is similar to the given sketch. We demonstrate results of experiments based on proposed methods for photo to sketch matching on CUFS and CUFSF databases.

New solutions for face photo retrieval based on sketches

The problem of face photo retrieval using sketches constructed based on a description provided by a witness is discussed. The status of this problem from primary concepts and the used terminology, to modern technologies for constructing sketches, real scenarios and search results is reviewed. The development history of systems for constructing facial composites (identikits and sketches) and the ideas realized in these systems are provided. The task of automatically searching through a database of original photo images using a face sketch is discussed, and the reasons of low performance of such search in real-world scenarios are brought to light. Requirements to databases of sketches in addition to the existing benchmark face databases and also methods of creation of such databases are formulated. Within this framework the methods for generation a population of sketches from the initial sketch to improve the performance of sketch-based photo image retrieval systems are discussed. A method to increase the index of similarity in pairs sketch-photo based on computation of an average sketch from the generated population is provided. It is shown that such sketches are more similar to original photo images and their use in the discussed problem may lead to good results. But for all that, the created sketches meet the requirements of the truthful scenario as allow possibility of incomplete information in verbal descriptions. Results of experiments on CUHK Face Sketch and CUHK Face Sketch FERET databases and also open access sketches and corresponding photo images are discussed.

Representation and comparison methods for semantically different images

This paper discusses the methods of presentation and comparison of semantically unrelated images with an assessment of their similarity in original feature space, and in the Space of Canonical Variables (SCV). The projection of source images in SCV is implemented using a two-dimensional canonical correlation analysis algorithm (2D CCA/2D KLT).

A Gradient Method for Generating Facial Barcodes

We propose a method for generating standard type linear barcodes from facial images. Our method uses the difference in gradients of image brightness. It involves averaging the gradients into a limited number of intervals, quantization of the results into decimal digits from 0 to 9, and table conversion into the final barcode. The proposed solution is computationally low-cost and does not require the use of any specialized image processing software for generating facial barcodes in mobile systems. Results of tests conducted on the Face94 database show that the proposed method offers a new solution for use in real-world practice. The generated barcodes are stable against changes of scale, pose and mirroring of facial images, as well as changes of facial expressions and shadows on faces from local lighting.

Barcoding in Biometrics and Its Development

The problems of using barcoding in biometrics and its applications are discussed. An overview of the existing solutions to this problem is presented for the different biometric modalities: face, iris, fingerprints, DNA, voice, etc. It is shown that the factor limiting the use of barcoding in biometrics was the low capacity of barcodes. It is noted that at present this problem is being solved within the framework of color barcodes. In this case, the problems of barcoding in biometrics and its applications can be solved in a new way, and examples of these solutions are given in the article.