Md. Maruf Monwar

Multimodal Biometric System Using Rank-Level Fusion Approach

In many real-world applications, unimodal biometric systems often face significant limitations due to sensitivity to noise, intraclass variability, data quality, nonuniversality, and other factors. Attempting to improve the performance of individual matchers in such situations may not prove to be highly effective. Multibiometric systems seek to alleviate some of these problems by providing multiple pieces of evidence of the same identity. These systems help achieve an increase in performance that may not be possible using a single-biometric indicator. This paper presents an effective fusion scheme that combines information presented by multiple domain experts based on the rank-level fusion integration method. The developed multimodal biometric system possesses a number of unique qualities, starting from utilizing principal component analysis and Fishers linear discriminant methods for individual matchers (face, ear, and signature) identity authentication and utilizing the novel rank-level fusion method in order to consolidate the results obtained from different biometric matchers. The ranks of individual matchers are combined using the highest rank, Borda count, and logistic regression approaches. The results indicate that fusion of individual modalities can improve the overall performance of the biometric system, even in the presence of low quality data. Insights on multibiometric design using rank-level fusion and its performance on a variety of biometric databases are discussed in the concluding section.

FES: A System for Combining Face, Ear and Signature Biometrics Using Rank Level Fusion

Performance rate of unimodal biometric system is often reduced due to physiological defects, user mode and the environment. Multibiometric systems seek to alleviate some of these drawbacks by providing multiple evidences of the same identity. In this paper, we develop a multimodal biometric system, FES, based on principal component analysis (PCA) and Fishers linear discriminant (FLD) methods that will use face, ear and signature for identity identification and rank level fusion for consolidate the results obtained from these monomodal matchers. The ranks of individual matchers are combined using the Borda count method and the logistic regression method. The results indicate that fusing individual modalities improve the overall performance of the biometric system.

Markov chain model for multimodal biometric rank fusion

Multimodal biometric aims at increasing reliability of biometric systems through utilizing more than one biometric in decision-making process. An effective fusion scheme is necessary for combining information from various sources. Such information can be integrated at several distinct levels, such as sensor level, feature level, match score level, rank level, and decision level. In this paper, we present a multimodal biometric system utilizing face, iris, and ear biometric features through rank level fusion method using novel Markov chain approach. We first apply fisherimage technique to face and ear image databases for recognition and Hough transform and Hamming distance techniques for iris image recognition. The main contribution is in introducing Markov chain approach for biometric rank aggregation. One of the distinctive features of this method is that it satisfies the Condorcet criterion, which is essential in any fair rank aggregation system. The experimentation shows superiority of the proposed approach to other recently introduced biometric rank aggregation methods. The developed system can be effectively used by security and intelligence services for controlling access to prohibited areas and protecting important national or public information.

ROTATION INVARIANT MULTIVIEW FACE DETECTION USING SKIN COLOR REGRESSIVE MODEL AND SUPPORT VECTOR REGRESSION

In this paper, an automatic rotation invariant multiview face detection method, which utilizes modified Skin Color Model (SCM), is presented. First, Gaussian Mixture Model (GMM) and Support Vector Machine (SVM) based hybrid models are used to classify human skin regions from color images. The novelty of the adaptive hybrid model is its ability to predict the chromatic skin color band for individual images based on calibration differences of camera and luminance condition of environment. Classified skin regions are then converted to gray scale image with a threshold based on the predicted chromatic skin color bands, which further enhances detection performance. Next, Principle Component Analysis (PCA) is applied to gray segmented regions. Face detection is carried out based on the PCA-based extracted features, along with selected features, using support vector regression. The output of this procedure is used to report the final result of face detection. The proposed method is also beneficial for the rotation invariant face recognition problem.

Fusing multiple matcher's outputs for secure human identification

Multimodal biometrics is an emerging area of research that aims at increasing the reliability of biometric systems through utilising more than one biometric in decision-making process. An effective fusion scheme plays a key role in combining the information presented by the multiple domain experts. Such information can be integrated at several distinct levels, such as sensor level, feature level, match score level, rank level and decision level. This paper describes the combination process of different monomodal expert through rank and decision fusion methods using iris, ear and face biometrics for secure human authentication. For rank-level fusion, plurality voting, Borda count and logistic regression approaches are employed and compared, and for decision-level fusion, AND/OR, majority voting, weighted majority voting and behavioural knowledge space approaches have been implemented and tested. The key contribution of the paper is in comparison of the recognition performance of the developed multimodal system for all of the above approaches. The results indicate that fusing individual modalities improve the overall performance of the biometric system and the logistic regression rank-level fusion results in the highest recognition performance even in the presence of low-quality data.

A Robust Authentication System Using Multiple Biometrics

In this work, a multibiometric system has been developed to overcome the drawbacks associated with monomodal biometric systems, such as noise, intra-class variability, distinctiveness, non-universality and spoof attacks. Information from three different Fisher’s Linear Discriminant driven monomodal experts based on face, ear and signature biometric traits are combined through decision level fusion method. AND/OR, majority voting, weighted majority voting and behavioural knowledge space approaches of decision level fusion method are examined to achieve a higher recognition accuracy. Experimental results indicate that fusing information from multiple biometric traits can results in higher recognition rates. The system can be a contribution to homeland security or other intelligence departments.

Face Detection Using Skin Color Recursive Clustering and Recognition Using Multilinear PCA

In this paper, we present a robust approach for face recognition from video sequences. An automatic face detectoris employed which uses modified skin color modeling to detect human skin regions from the video sequences. The presence or absence of face in each region is verified by means of height width proportion and a Neural Network based template matching scheme. The obtained face images are then projected onto a feature space, defined by Multilinear Principal Component Analysis (MPCA), to produce the biometric feature template. Recognition is performed by projecting anew image onto the feature spaces by the MPCA that generalizes not only the classical PCA solution but also a number of the so-called 2-D PCA algorithms and then classifying the face by comparing its position in the feature spaces with the positions of known individuals. The proposed method is applicable to security systems, secure human computer interaction, visual communication systems (secure video conferencing) and virtual world environments.

Current Trends in Multimodal Biometric System—Rank Level Fusion

Biometric identification referes to idetifying an individual based on his or her physilogical or beavioral characteristics. The use of more than one biometric identfiers in a biometric system, called the multimodal biometric system, increases the overall system accuracy and hence increase security, as well as reduce the enrollment problems. An effective and appropriate fusion strategy is needed to integrate different biometric information in such multimodal systems. This chapter provides an in-depth overview of traditional multimodal biometric systems and current trends in multimodal biometric fusion. Various approaches of rank level fusion, which is an not heavily investigated by researchers yet, are also illustrated in details in this chapter. Pros and cons of these rank fusion approaches are discussed which can be helpful for large scale multimodal biometric system deployment.

Video analysis for view-based painful expression recognition

In recent years, facial expressions of pain have been the focus of considerable behavioral research. Such work has documented that pain expressions, like other affective facial expressions, play an important role in social communication. Enabling computer systems to recognize pain expression from facial images is a challenging research topic. In this paper, we present two systems for pain recognition from video sequences. The first approach, eigenimage, projects the face images, detected from video sequences, onto a feature space, defined by eigenfaces, to produce the biometric template. Recognition is performed by projecting a new image onto that feature space and then classifying the face by comparing its position in the feature spaces with the positions of known individuals. To ensure better accuracy, the system is tested against two more feature spaces defined by eigeneyes and eigenlips. The second approach, neural network, extracts location and shape features of the detected faces and uses them as inputs to the artificial neural network which employs the standard error back-propagation algorithm for classification of faces. From experiments, we conclude that neural network based method is better in terms of speed and accuracy than eigenimage based method.

Support vector machine for automatic pain recognition

Facial expressions are a key index of emotion and the interpretation of such expressions of emotion is critical to everyday social functioning. In this paper, we present an efficient video analysis technique for recognition of a specific expression, pain, from human faces. We employ an automatic face detector which detects face from the stored video frame using skin color modeling technique. For pain recognition, location and shape features of the detected faces are computed. These features are then used as inputs to a support vector machine (SVM) for classification. We compare the results with neural network based and eigenimage based automatic pain recognition systems. The experiment results indicate that using support vector machine as classifier can certainly improve the performance of automatic pain recognition system.