Logo image
DCFace: Synthetic Face Generation with Dual Condition Diffusion Model
Conference proceeding   Open access

DCFace: Synthetic Face Generation with Dual Condition Diffusion Model

Minchul Kim, Feng Liu, Anil Jain, Feng Liu and Xiaoming Liu
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 12715-12725
Jun 2023
url
http://arxiv.org/abs/2304.07060View

Abstract

Biometrics Diversity reception Face recognition Lighting Performance gain Solid modeling Three-dimensional displays Training
Generating synthetic datasets for training face recognition models is challenging because dataset generation entails more than creating high fidelity images. It involves generating multiple images of same subjects under different factors (e.g., variations in pose, illumination, expression, aging and occlusion) which follows the real image conditional distribution. Previous works have studied the generation of synthetic datasets using GAN or 3D models. In this work, we approach the problem from the aspect of combining subject appearance (ID) and external factor (style) conditions. These two conditions provide a direct way to control the inter-class and intra-class variations. To this end, we propose a Dual Condition Face Generator (DCFace) based on a diffusion model. Our novel Patch-wise style extractor and Time-step dependent ID loss enables DCFace to consistently produce face images of the same subject under different styles with precise control. Face recognition models trained on synthetic images from the proposed DCFace provide higher verification accuracies compared to previous works by 6.11% on average in 4 out of 5 test datasets, LFW, CFP-FP, CPLFW, AgeDB and CALFW. Code Link

Metrics

9 Record Views
91 citations in Scopus

Details

UN Sustainable Development Goals (SDGs)

This publication has contributed to the advancement of the following goals:

#3 Good Health and Well-Being

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Web of Science research areas
Computer Science, Artificial Intelligence
Logo image