Archive | 2019
Occluded Face Recognition by Identity-Preserving Inpainting
Abstract
Occluded face recognition, which has an attractive application in the visual analysis field, is challenged by the missing cues due to heavy occlusions. Recently, several face inpainting methods based on generative adversarial networks (GANs) fill in the occluded parts by generating images fitting the real image distributions. They can lead to a visually natural result and satisfy human perception. However, these methods fail to capture the identity attributes, thus the inpainted faces may be recognized at a low accuracy by machine. To enable the convergence of human perception and machine perception, this paper proposes an Identity Preserving Generative Adversary Networks (IP-GANs) to jointly inpaint and recognize occluded faces. The IP-GANs consists of an inpainting network for regressing missing facial parts, a global-local discriminative network for guiding the inpainted face to the real conditional distribution, a parsing network for enhancing structure consistence and an identity network for recovering missing identity cues. Especially, the novel identity network suppresses the identity diffusion by constraining the feature consistence from the early subnetwork of a well-trained face recognition network between the inpainted face and its corresponding ground-true. In this way, it regularizes the inpaintor, enforcing the generated faces to preserve identity attributes. Experimental results prove the proposed IP-GANs capable of dealing with varieties of occlusions and producing photorealistic and identity-preserving results, promoting occluded face recognition performance.