Interactive NeRF Geometry Editing With Shape Priors
文献类型：期刊论文
| 作者 | Yuan, Yu-Jie5,6; Sun, Yang-Tian5,6; Lai, Yu-Kun4; Ma, Yuewen3; Jia, Rongfei2; Kobbelt, Leif1; Gao, Lin5,6 |
| 刊名 | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
 |
| 出版日期 | 2023-12-01 |
| 卷号 | 45期号:12页码:14821-14837 |
| 关键词 | Neural radiance fields geometry editing shape deformation interactive editing |
| ISSN号 | 0162-8828 |
| DOI | 10.1109/TPAMI.2023.3315068 |
| 英文摘要 | Neural Radiance Fields (NeRFs) have shown great potential for tasks like novel view synthesis of static 3D scenes. Since NeRFs are trained on a large number of input images, it is not trivial to change their content afterwards. Previous methods to modify NeRFs provide some control but they do not support direct shape deformation which is common for geometry representations like triangle meshes. In this paper, we present a NeRF geometry editing method that first extracts a triangle mesh representation of the geometry inside a NeRF. This mesh can be modified by any 3D modeling tool (we use ARAP mesh deformation). The mesh deformation is then extended into a volume deformation around the shape which establishes a mapping between ray queries to the deformed NeRF and the corresponding queries to the original NeRF. The basic shape editing mechanism is extended towards more powerful and more meaningful editing handles by generating box abstractions of the NeRF shapes which provide an intuitive interface to the user. By additionally assigning semantic labels, we can even identify and combine parts from different objects. We demonstrate the performance and quality of our method in a number of experiments on synthetic data as well as real captured scenes. |
| 资助项目 | National Natural Science Foundation of China[62061136007] ; Beijing Municipal Natural Science Foundation for Distinguished Young Scholars[JQ21013] ; Royal Society Newton Advanced Fellowship[NAF \ R2\192151] ; Youth Innovation Promotion AssociationCAS |
| WOS研究方向 | Computer Science ; Engineering |
| 语种 | 英语 |
| WOS记录号 | WOS:001130146400048 |
| 出版者 | IEEE COMPUTER SOC |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/38361]  |
| 专题 | 中国科学院计算技术研究所期刊论文_英文 |
| 通讯作者 | Gao, Lin |
| 作者单位 | 1.Rhein Westfal TH Aachen, Comp Graph Grp, D-52062 Aachen, Germany 2.Beijing ZaoWuHuiJing Technol Co Ltd, Beijing 102206, Peoples R China 3.PICO, ByteDance, Beijing 100086, Peoples R China 4.Cardiff Univ, Sch Comp Sci Informat, Cardiff CF10 3AT, Wales 5.Univ Chinese Acad Sci, Beijing 101408, Peoples R China 6.Chinese Acad Sci, Inst Comp Technol, Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100045, Peoples R China |
| 推荐引用方式 GB/T 7714 | Yuan, Yu-Jie,Sun, Yang-Tian,Lai, Yu-Kun,et al. Interactive NeRF Geometry Editing With Shape Priors[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2023,45(12):14821-14837. |
| APA | Yuan, Yu-Jie.,Sun, Yang-Tian.,Lai, Yu-Kun.,Ma, Yuewen.,Jia, Rongfei.,...&Gao, Lin.(2023).Interactive NeRF Geometry Editing With Shape Priors.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,45(12),14821-14837. |
| MLA | Yuan, Yu-Jie,et al."Interactive NeRF Geometry Editing With Shape Priors".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 45.12(2023):14821-14837. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。