Designing a 3D-Aware StyleNeRF Encoder for Face Editing
文献类型:会议论文
| 作者 | Yang, Songlin ; Wang, Wei; Peng, Bo; Dong, Jing
|
| 出版日期 | 2023-04 |
| 会议日期 | 2023-6-8 |
| 会议地点 | Greek island of Rhodes |
| 英文摘要 | GAN inversion has been exploited in many face manipulation tasks, but 2D GANs often fail to generate multi-view 3D consistent images. The encoders designed for 2D GANs are not able to provide sufficient 3D information for the inversion and editing. Therefore, 3D-aware GAN inversion is proposed to increase the 3D editing capability of GANs. However, the 3D-aware GAN inversion remains under-explored. To tackle this problem, we propose a 3D-aware (3Da) encoder for GAN inversion and face editing based on the powerful StyleNeRF model. Our proposed 3Da encoder combines a parametric 3D face model with a learnable detail representation model to generate geometry, texture and view direction codes. For more flexible face manipulation, we then design a dual-branch StyleFlow module to transfer the StyleNeRF codes with disentangled geometry and texture flows. Extensive experiments demonstrate that we realize 3D consistent face manipulation in both facial attribute editing and texture transfer. Furthermore, for video editing, we make the sequence of frame codes share a common canonical manifold, which improves the temporal consistency of the edited attributes. |
| 源URL | [http://ir.ia.ac.cn/handle/173211/57548] ![]() |
| 专题 | 自动化研究所_智能感知与计算研究中心 |
| 通讯作者 | Wang, Wei |
| 作者单位 | Institute of Automation, Chinese Academy of Sciences(CASIA) |
| 推荐引用方式 GB/T 7714 | Yang, Songlin,Wang, Wei,Peng, Bo,et al. Designing a 3D-Aware StyleNeRF Encoder for Face Editing[C]. 见:. Greek island of Rhodes. 2023-6-8. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。

