中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Designing a 3D-Aware StyleNeRF Encoder for Face Editing

文献类型:会议论文

作者Yang, Songlin; Wang, Wei; Peng, Bo; Dong, Jing
出版日期2023-04
会议日期2023-6-8
会议地点Greek island of Rhodes
英文摘要

GAN inversion has been exploited in many face manipulation tasks, but 2D GANs often fail to generate multi-view 3D consistent images. The encoders designed for 2D GANs are not able to provide sufficient 3D information for the inversion and editing. Therefore, 3D-aware GAN inversion is proposed to increase the 3D editing capability of GANs. However, the 3D-aware GAN inversion remains under-explored. To tackle this problem, we propose a 3D-aware (3Da) encoder for GAN inversion and face editing based on the powerful StyleNeRF model. Our proposed 3Da encoder combines a parametric 3D face model with a learnable detail representation model to generate geometry, texture and view direction codes. For more flexible face manipulation, we then design a dual-branch StyleFlow module to transfer the StyleNeRF codes with disentangled geometry and texture flows. Extensive experiments demonstrate that we realize 3D consistent face manipulation in both facial attribute editing and texture transfer. Furthermore, for video editing, we make the sequence of frame codes share a common canonical manifold, which improves the temporal consistency of the edited attributes.

源URL[http://ir.ia.ac.cn/handle/173211/57548]  
专题自动化研究所_智能感知与计算研究中心
通讯作者Wang, Wei
作者单位Institute of Automation, Chinese Academy of Sciences(CASIA)
推荐引用方式
GB/T 7714
Yang, Songlin,Wang, Wei,Peng, Bo,et al. Designing a 3D-Aware StyleNeRF Encoder for Face Editing[C]. 见:. Greek island of Rhodes. 2023-6-8.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。