Towards High Fidelity Face Frontalization in the Wild
文献类型:期刊论文
作者 | Cao, Jie1,2![]() ![]() ![]() ![]() ![]() |
刊名 | International Journal of Computer Vision
![]() |
出版日期 | 2019 |
卷号 | 128期号:1页码:1485–1504 |
关键词 | Face frontalization Realistic face generation Pose-invariant face recognition |
英文摘要 | Face frontalization refers to the process of synthesizing the frontal view of a face from a given profile. Due to self-occlusion and appearance distortion in the wild, it is extremely challenging to recover faithful high-resolution results meanwhile preserve texture details. This paper proposes a high fidelity pose in-variant model (HF-PIM) to produce photographic and identity-preserving results. HF-PIM frontalizes the profiles through a novel texture fusion warping procedure and leverages a dense correspondence field to bind the 2D and 3D surface spaces. We decompose the prerequisite of warping into dense correspondence field estimation and facial texture map recovering, which are both well addressed by deep networks. Different from those reconstruction methods relying on 3D data, we also propose adversarial residual dictionary learning to supervise facial texture map recovering with only monocular images. Furthermore, a multi-perception guided loss is proposed to address the practical misalignment between the ground truth frontal and profile faces, allowing HF-PIM to effectively utilize multiple images during training. Quantitative and qualitative evaluations on five controlled and uncontrolled databases show that the proposed method not only boosts the performance of pose-invariant face recognition but also improves the visual quality of high-resolution frontalization appearances. |
语种 | 英语 |
源URL | [http://ir.ia.ac.cn/handle/173211/44303] ![]() |
专题 | 自动化研究所_智能感知与计算研究中心 |
通讯作者 | Sun, Zhenan |
作者单位 | 1.中国科学院大学 2.中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Cao, Jie,Hu, Yibo,Zhang, Hongwen,et al. Towards High Fidelity Face Frontalization in the Wild[J]. International Journal of Computer Vision,2019,128(1):1485–1504. |
APA | Cao, Jie,Hu, Yibo,Zhang, Hongwen,He, Ran,&Sun, Zhenan.(2019).Towards High Fidelity Face Frontalization in the Wild.International Journal of Computer Vision,128(1),1485–1504. |
MLA | Cao, Jie,et al."Towards High Fidelity Face Frontalization in the Wild".International Journal of Computer Vision 128.1(2019):1485–1504. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。