3D Aided Duet GANs for Multi-View Face Image Synthesis
文献类型：期刊论文
| 作者 | Cao, Jie1,2 ; Hu, Yibo1,2; Yu, Bing3; He, Ran1,2; Sun, Zhenan1,2
|
| 刊名 | IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY
 |
| 出版日期 | 2019-08-01 |
| 卷号 | 14期号:8页码:2028-2042 |
| 关键词 | Face rotation and frontalization multi-view face synthesis pose-invariant face recognition face reconstruction |
| ISSN号 | 1556-6013 |
| DOI | 10.1109/TIFS.2019.2891116 |
| 通讯作者 | Cao, Jie(jie.cao@cripac.ia.ac.cn) |
| 英文摘要 | Multi-view face synthesis from a single image is an ill-posed computer vision problem. It often suffers from appearance distortions if it is not well-defined. Producing photo-realistic and identity preserving multi-view results is still a not well-defined synthesis problem. This paper proposes 3D aided duet generative adversarial networks (AD-GAN) to precisely rotate the yaw angle of an input face image to any specified angle. AD-GAN decomposes the challenging synthesis problem into two well-constrained subtasks that correspond to a face normalizer and a face editor. The normalizer first frontalizes an input image, and then the editor rotates the frontalized image to a desired pose guided by a remote code. In the meantime, the face normalizer is designed to estimate a novel dense UV correspondence field, making our model aware of 3D face geometry information. In order to generate photo-realistic local details and accelerate convergence process, the normalizer and the editor are trained in a two-stage manner and regulated by a conditional self-cycle loss and a perceptual loss. Exhaustive experiments on both controlled and uncontrolled environments demonstrate that the proposed method not only improves the visual realism of multi-view synthetic images but also preserves identity information well. |
| WOS关键词 | SHAPE |
| 资助项目 | National Natural Science Foundation of China[U1836217] ; National Natural Science Foundation of China[61427811] ; National Natural Science Foundation of China[61573360] ; National Natural Science Foundation of China[61721004] ; National Key Research and Development Program of China[2017YFC0821602] |
| WOS研究方向 | Computer Science ; Engineering |
| 语种 | 英语 |
| WOS记录号 | WOS:000467523400006 |
| 出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| 资助机构 | National Natural Science Foundation of China ; National Key Research and Development Program of China |
| 源URL | [http://ir.ia.ac.cn/handle/173211/24595]  |
| 专题 | 自动化研究所_智能感知与计算研究中心 |
| 通讯作者 | Cao, Jie |
| 作者单位 | 1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Ctr Res Intelligent Percept & Comp,Ctr Excellence, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 101408, Peoples R China 3.Huawei Technol Co Ltd, Noahs Ark Lab, Beijing 100085, Peoples R China |
| 推荐引用方式 GB/T 7714 | Cao, Jie,Hu, Yibo,Yu, Bing,et al. 3D Aided Duet GANs for Multi-View Face Image Synthesis[J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY,2019,14(8):2028-2042. |
| APA | Cao, Jie,Hu, Yibo,Yu, Bing,He, Ran,&Sun, Zhenan.(2019).3D Aided Duet GANs for Multi-View Face Image Synthesis.IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY,14(8),2028-2042. |
| MLA | Cao, Jie,et al."3D Aided Duet GANs for Multi-View Face Image Synthesis".IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY 14.8(2019):2028-2042. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。