Miroslav Hamouz

The BANCA database and evaluation protocol

In this paper we describe the acquisition and content of a new large, realistic and challenging multi-modal database intended for training and testing multi-modal verification systems. The BANCA database was captured in four European languages in two modalities (face and voice). For recording, both high and low quality microphones and cameras were used. The subjects were recorded in three different scenarios, controlled, degraded and adverse over a period of three months. In total 208 people were captured, half men and half women. In this paper we also describe a protocol for evaluating verification algorithms on the database. The database will be made available to the research community through http://www.ee.surrey.ac.uk/Research/VSSP/banca.

Feature-based affine-invariant localization of faces

We present a novel method for localizing faces in person identification scenarios. Such scenarios involve high resolution images of frontal faces. The proposed algorithm does not require color, copes well in cluttered backgrounds, and accurately localizes faces including eye centers. An extensive analysis and a performance evaluation on the XM2VTS database and on the realistic BioID and BANCA face databases is presented. We show that the algorithm has precision superior to reference methods.

3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approachest

3D face recognition has lately been attracting ever increasing attention. In this paper we review the full spectrum of 3D face processing technology, from sensing to recognition. The review covers 3D face modelling, 3D to 3D and 3D to 2D registration, 3D based recognition and 3D assisted 2D based recognition. The fusion of 2D and 3D modalities is also addressed. The paper complements other reviews in the face biometrics area by focusing on the sensor technology, and by detailing the efforts in 3D face modelling and 3D assisted 2D face matching.

Face Authentication Competition on the BANCA Database

This paper details the results of a face verification competition [2] held in conjunction with the First International Conference on Biometric Authentication. The contest was held on the publically available BANCA database [1] according to a defined protocol [6]. Six different verification algorithms from 4 academic and commercial institutions submitted results. Also, a standard set of face recognition software from the internet [3] was used to provide a baseline performance measure.

Image Feature Localization by Multiple Hypothesis Testing of Gabor Features

Several novel and particularly successful object and object category detection and recognition methods based on image features, local descriptions of object appearance, have recently been proposed. The methods are based on a localization of image features and a spatial constellation search over the localized features. The accuracy and reliability of the methods depend on the success of both tasks: image feature localization and spatial constellation model search. In this paper, we present an improved algorithm for image feature localization. The method is based on complex-valued multiresolution Gabor features and their ranking using multiple hypothesis testing. The algorithm provides very accurate local image features over arbitrary scale and rotation. We discuss in detail issues such as selection of filter parameters, confidence measure, and the magnitude versus complex representation, and show on a large test sample how these influence the performance. The versatility and accuracy of the method is demonstrated on two profoundly different challenging problems (faces and license plates).

Affine-invariant face detection and localization using GMM-based feature detector and enhanced appearance model

We present an affine-invariant face detection and localization using GMM-based feature detector and enhanced appearance model. We measure the performance of the method on the realistic BioID and also XM2VTS databases applying a stringent localization error criterion. Compared to our original method, the results have improved by a factor of 2 and are considerably better on a challenging database than those of a baseline method.

A Validated Method for Dense Non-rigid 3D Face Registration

Deformable surface fitting methods have been widely used to establish dense correspondence across different 3D objects of the same class. Dense correspondence is a critical step in constructing morphable face models for face recognition. In this paper a mainstream method for constructing dense correspondences is evaluated on 912 3D face scans from the Face Recognition Grand Challenge FRGC V1 database. A number of modifications to the standard deformable surface approach are introduced to overcome limitations identified in the evaluation. Proposed modifications include multi-resolution fitting, adaptive correspondence search range and enforcing symmetry constraints. The modified deformable surface approach is validated on the 912 FRGC 3D face scans and is shown to overcome limitations of the standard approach which resulted in gross fitting errors. The modified approach halves the rms fitting error with 98% of points within 0.5mm of their true position compared to 67% with the standard approach.

2D face pose normalisation using a 3D morphable model

The ever growing need for improved security, surveillance and identity protection, calls for the creation of evermore reliable and robust face recognition technology that is scalable and can be deployed in all kinds of environments without compromising its effectiveness. In this paper we study the impact that pose correction has on the performance of 2D face recognition. To measure the effect, we use a state of the art 2D recognition algorithm. The pose correction is performed by means of 3D morphable model. Our results on the non frontal XM2VTS database showed that pose correction can improve recognition rates up to 30%.

Hypotheses-driven affine invariant localization of faces in verification systems

We propose a novel framework for localizing human faces in client authentication scenarios based on correspondences between triplets of detected Gabor-based local features and their counterparts in a generic affine invariant face appearance model. The method is robust to partial occlusion, feature detector failure and copes well with cluttered background. The method was tested on the BANCA database and produced promising results.

Face Detection by Learned Affine Correspondences

We propose a novel framework for detecting human faces based on correspondences between triplets of detected local features and their counterparts in an affine invariant face appearance model.Th e method is robust to partial occlusion, feature detector failure and copes well with cluttered background. Both the appearance and configuration probabilities are learned from examples. The method was tested on the XM2VTS database and a limited number of images with cluttered background with promising results - 2% false negative rate - was obtained.