中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Semantic 3D-Aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field

文献类型:会议论文

作者Tianxiang Ma1,2; Bingchuan Li4; Qian He4; Jing Dong1; Tieniu Tan1,3
出版日期2023
会议日期2.7-2.14
会议地点美国华盛顿
英文摘要

Recently 3D-aware GAN methods with neural radiance field have developed rapidly. However, current methods model the whole image as an overall neural radiance field, which limits the partial semantic editability of synthetic results. Since NeRF renders an image pixel by pixel, it is possible to split NeRF in the spatial dimension. We propose a Compositional Neural Radiance Field (CNeRF) for semantic 3D-aware portrait synthesis and manipulation. CNeRF divides the image by semantic regions and learns an independent neural radiance field for each region, and finally fuses them and renders the complete image. Thus we can manipulate the synthesized semantic regions independently, while fixing the other parts unchanged. Furthermore, CNeRF is also designed to decouple shape and texture within each semantic region. Compared to state-of-the-art 3D-aware GAN methods, our approach enables fine-grained semantic region manipulation, while maintaining high-quality 3D-consistent synthesis. The ablation studies show the effectiveness of the structure and loss function used by our method. In addition real image inversion and cartoon portrait 3D editing experiments demonstrate the application potential of our method.

源URL[http://ir.ia.ac.cn/handle/173211/56661]  
专题自动化研究所_智能感知与计算研究中心
通讯作者Jing Dong
作者单位1.CRIPAC & NLPR, Institute of Automation, Chinese Academy of Sciences
2.School of Artificial Intelligence, University of Chinese Academy of Sciences
3.Nanjing University
4.ByteDance Ltd, Beijing, China
推荐引用方式
GB/T 7714
Tianxiang Ma,Bingchuan Li,Qian He,et al. Semantic 3D-Aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field[C]. 见:. 美国华盛顿. 2.7-2.14.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。