Padma Polash Paul

Multimodal Cancelable Biometrics

Multimodal biometric systems have emerged as highly successful new approach to combat problems of unimodal biometric system such as intraclass variability, interclass similarity, data quality, non-universality, and sensitivity to noise. However, one major issue pertinent to unimodal system remains. It has to do with actual biometric characteristics of users being permanent, and their number being limited. Thus, if users biometric is compromised, it might be impossible or highly difficult to replace it in a particular system. Cancellable biometric for individual biometric has been a significantly understudied problem. The concept of cancelable biometric or cancelability is to transform a biometric data or feature into a new one so that users can change their single biometric template in a biometric security system. However, cancelability in multimodal biometric has been barely addressed at all. In this paper, we tackle the problem and present a novel solution for cancelable biometrics in multimodal system. We develop a new cancelable biometric template generation algorithm using random projection and transformation-based feature extraction and selection. Performance of the proposed algorithm is validated on multi-modal face and ear database.

A Concept of Social Behavioral Biometrics: Motivation, Current Developments, and Future Trends

A person can be identified from his physiological traits as well as from behavioral patterns. However, a persons behavior is not only confined to individual actions such as walking or typing style, speech or handwriting but also social interactions and communication. In other words, social communication is an indispensable part of our daily behavior. Therefore, a persons social connections, spatio-temporal information, style of interactions etc. Can be a good source of information to identify his social behavioral pattern. Based on this hypothesis, this paper introduces a novel kind of behavioral biometrics called Social Behavioral Biometrics (SBB) for the first time. The study includes identification of social behavioral biometric features from real and virtual domain and their prospective applications for the purpose of person authentication and verification.

DTW-based kernel and rank-level fusion for 3D gait recognition using Kinect

This paper presents a new 3D gait recognition method that utilizes the kinect skeleton data for representing the gait signature. We propose to use two new features, namely joint relative distance (JRD) and joint relative angle (JRA), which are robust against view and pose variations. The relevance of each JRD and JRA sequence in representing human gait is evaluated using a genetic algorithm. We also introduce a dynamic time warping-based kernel that takes a collection of JRD or JRA sequences as parameters and computes a dissimilarity measure between the training and the unknown sample. The proposed kernel can effectively handle variable walking speed without any need of extra pre-processing. In addition, we propose a rank-level fusion of JRD and JRA features that can boost the overall recognition performance greatly. The effectiveness of the proposed method is evaluated using a 3D skeletal gait database captured with a Kinect v2 sensor. In our experiments, rank level fusion of joint relative distance (JRD) and joint relative angle (JRA) achieves promising results, as compared against only JRD and only JRA-based gait recognition.

Decision Fusion for Multimodal Biometrics Using Social Network Analysis

This paper presents for the first time decision fusion for multimodal biometric system using social network analysis (SNA). The main challenge in the design of biometric systems, at present, lies in unavailability of high-quality data to ensure consistently high recognition results. Resorting to multimodal biometric partially solves the problem, however, issues with dimensionality reduction, classifier selection, and aggregated decision making remain. The presented methodology successfully overcomes the problem through employing novel decision fusion using SNA. While several types of feature extractors can be used to reduce the dimension and identify significant features, we chose the Fisher Linear Discriminant Analysis as one of the most efficient methods. Social networks are constructed based on similarity and correlation of features among the classes. The final classification result is generated based on the two levels of decision fusion methods. At the first level, individual biometrics (face or ear or signature) are classified using matching score methodology. SNA is used to reinforce the confidence level of the classifier to reduce the error rate. In the second level, outcomes of classification based on individual biometrics are fused together to obtain the final decision.

ROTATION INVARIANT MULTIVIEW FACE DETECTION USING SKIN COLOR REGRESSIVE MODEL AND SUPPORT VECTOR REGRESSION

In this paper, an automatic rotation invariant multiview face detection method, which utilizes modified Skin Color Model (SCM), is presented. First, Gaussian Mixture Model (GMM) and Support Vector Machine (SVM) based hybrid models are used to classify human skin regions from color images. The novelty of the adaptive hybrid model is its ability to predict the chromatic skin color band for individual images based on calibration differences of camera and luminance condition of environment. Classified skin regions are then converted to gray scale image with a threshold based on the predicted chromatic skin color bands, which further enhances detection performance. Next, Principle Component Analysis (PCA) is applied to gray segmented regions. Face detection is carried out based on the PCA-based extracted features, along with selected features, using support vector regression. The output of this procedure is used to report the final result of face detection. The proposed method is also beneficial for the rotation invariant face recognition problem.

Social Behavioral Biometrics: An Emerging Trend

In todays world, identity of human beings has expanded beyond the real world to the cyber world. Virtual identity of millions of users is present at various web-based Social Networking Sites (SNSs) such as Myspace, Facebook, and Twitter. Interactions through SNSs have become a part of our daily practices, which eventually leaves a big trail of behavioral pattern in virtual domain. In this paper, the authors examined the feasibility of person identification using such social network activities as behavioral biometrics. Experimentation includes extraction of a number of idiosyncratic features from SNSs and analysis of their performance as novel social behavioral biometric features.

PCA Based Geometric Modeling for Automatic Face Detection

In this paper, PCA based modeling of geometric structure of the face for automatic face detection is presented. The method improves the face detection rate and limits the search space. Skin Color Modeling (SCM) is one of the best face detection techniques for image and video. However, feature selection is very important for even better template matching performance in terms of detection rate and time. This paper presents an efficient feature extraction and selection method based on geometric structure of the facial image boundary and interior. To model the geometric structure of face, Principle Component Analysis (PCA) and canny edge detection are used. Fusion of PCA based geometric modeling and SCM method provides higher face detection accuracy and improves time complexity. Both models provide filtering of image in term of pixel values to get the face location that are very fast and efficient for large image databases.

Situation awareness of cancelable biometric system

Recently, cancelable biometrics emerged as one of the highly effective methods of template protection. The concept behind the cancelable biometrics or cancelability is a transformation of a biometric data or extracted feature into an alternative form, which cannot be used by the imposter or intruder easily, and can be revoked if compromised. In this paper, we present a novel architecture for template generation in the context of situation awareness system in real and virtual applications. We develop a novel cancelable biometric template generation algorithm utilizing random biometric fusion, random projection and selection. Proposed random cross-folding method generate cancelable biometric template from multiple biometric traits. We further validate the performance of the proposed algorithm using a virtual multimodal face and ear database.

Social Behavioral Information Fusion in Multimodal Biometrics

The goal of a biometric recognition system is to make a human-like decisions on individual’s identity by recognizing their physiological and/or behavioral traits. Nevertheless, the decision-making process by either a human or a biometric recognition system can be highly complicated due to low quality of data or an uncertain environment. Human brain has an advantage over computer system due to its ability to perform a massive parallel processing of auxiliary information, such as visual cues, cognitive and social interactions, contextual, and spatio-temporal data. Similarly to a human brain, social behavioral cues can aid the reliable decision-making of an automated biometric system. In this paper, a novel person recognition approach is presented, that relies on the knowledge of individuals’ social behavior to enhance the performance of a traditional biometric system. The social behavioral information of individuals’ has been mined from an online social network and fused with traditional face and ear biometrics. Experimental results on individual’s and semi-real databases demonstrate significant performance gain in the proposed method over traditional biometric system.

Mining Social Behavioral Biometrics in Twitter

Online Social Networking Sites (SNSs) are considered as one of the well-established mediums of mass communication in todays world. Similar to physical world humans tend to have unique pattern of social communication in virtual world. However, analysis of such web based communication patterns is rarely seen for person identification. Most of the existing biometric recognition systems use either individual physiological or behavioural traits. A framework for the analysis of the web-based social interaction data as biometric features is largely unexplored until now. In this paper, a framework to accumulate and analyze social communication based data from online SNSs is presented. Analysis of such features explores personal characteristics, knowledge, and communication patterns that can successfully be utilized as Social Behavioral Biometric features. Experimental results demonstrate that the proposed social behavioral biometric features are significantly useful for person authentication.