David Fofi

Heart rate estimation using facial video: A review

Abstract Photoplethysmography and Ballistocardiography are two concepts that are used to measure heart rate from human, by using facial videos. Heart rate estimation is essential to determine the physiological and pathological state of a person. This paper presents a critical review of digital camera based heart rate estimating method on facial skin. This review extends the investigation on to the principles and theory behind photoplethysmography and ballistocardiography. The article contains reviews on the significance of the methods and contributions to overcome challenges such as; poor signal strength, illumination variance, and motion variance. The experiments were conducted to validate the state of the art methods on a challenging database that is available publicly. The implemented methods were validated using the database, on 27 subjects for a range of skin tones from pearl white, fair, olive to black. The results were computed using statistical methods such as: mean error, standard deviation, the root mean square error, Pearson correlation coefficient, and Bland-Altman analysis. The results derived from the experiments showed the reliability of the state of the art methods and provided direction to improve for situations involving illumination variance and motion variance.

Dynamic 3D Scene Reconstruction and Enhancement

In this paper, we present a 3D reconstruction and enhancement approach for high quality dynamic city scene reconstructions. We first detect and segment the moving objects using 3D Motion Segmentation approach by exploiting the feature trajectories’ behaviours. Getting the segmentations of both the dynamic scene parts and the static scene parts, we propose an efficient point cloud registration approach which takes the advantages of 3-point RANSAC and Iterative Closest Points algorithms to produce precise point cloud alignment. Furthermore, we proposed a point cloud smoothing and texture mapping framework to enhance the results of reconstructions for both the static and the dynamic scene parts. The proposed algorithms are evaluated using the real-world challenging KITTI dataset with very satisfactory results.

Novel health monitoring method an using RGB camera

In this paper we present a novel health monitoring method by estimating the heart rate and respiratory rate using an RGB camera. The heart rate and the respiratory rate are estimated from the photoplethysmography (PPG) and the respiratory motion. The method mainly operates by using the green spectrum of the RGB camera to generate a multivariate PPG signal to perform multivariate de-noising on the video signal to extract the resultant PPG signal. A periodicity based voting scheme (PVS) was used to measure the heart rate and respiratory rate from the estimated PPG signal. We evaluated our proposed method with a state of the art heart rate measuring method for two scenarios using the MAHNOB-HCI database and a self collected naturalistic environment database. The methods were furthermore evaluated for various scenarios at naturalistic environments such as a motion variance session and a skin tone variance session. Our proposed method operated robustly during the experiments and outperformed the state of the art heart rate measuring methods by compensating the effects of the naturalistic environment.