Neural3Points: Learning to Generate Physically Realistic Full-body Motion for Virtual Reality Users
文献类型：期刊论文
| 作者 | Ye, Yongjing2,3; Liu, Libin1; Hu, Lei2,3; Xia, Shihong2,3 |
| 刊名 | COMPUTER GRAPHICS FORUM
 |
| 出版日期 | 2022-12-01 |
| 卷号 | 41期号:8页码:183-194 |
| ISSN号 | 0167-7055 |
| DOI | 10.1111/cgf.14634 |
| 英文摘要 | Animating an avatar that reflects a user's action in the VR world enables natural interactions with the virtual environment. It has the potential to allow remote users to communicate and collaborate in a way as if they met in person. However, a typical VR system provides only a very sparse set of up to three positional sensors, including a head-mounted display (HMD) and Optionally two hand-held controllers, making the estimation of the user's full-body movement a difficult problem. In this work, we present a data-driven physics-based method for predicting the realistic full-body movement of the user according to the transformations of these VR trackers and simulating an avatar character to mimic such user actions in the virtual world in realtime. We train our system using reinforcement learning with carefully designed pretraining processes to ensure the success of the training and the quality of the simulation. We demonstrate the effectiveness of the method with an extensive set of examples. |
| 资助项目 | National Key R&D Program of Science and Technology for Winter Olympics[2020YFF0304701] ; National Natural Science Foundation of China[61772499] |
| WOS研究方向 | Computer Science |
| 语种 | 英语 |
| 出版者 | WILEY |
| WOS记录号 | WOS:001047605100018 |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/21173]  |
| 专题 | 中国科学院计算技术研究所期刊论文_英文 |
| 通讯作者 | Liu, Libin; Xia, Shihong |
| 作者单位 | 1.Peking Univ, Beijing, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 3.Univ Chinese Acad Sci, Beijing, Peoples R China |
| 推荐引用方式 GB/T 7714 | Ye, Yongjing,Liu, Libin,Hu, Lei,et al. Neural3Points: Learning to Generate Physically Realistic Full-body Motion for Virtual Reality Users[J]. COMPUTER GRAPHICS FORUM,2022,41(8):183-194. |
| APA | Ye, Yongjing,Liu, Libin,Hu, Lei,&Xia, Shihong.(2022).Neural3Points: Learning to Generate Physically Realistic Full-body Motion for Virtual Reality Users.COMPUTER GRAPHICS FORUM,41(8),183-194. |
| MLA | Ye, Yongjing,et al."Neural3Points: Learning to Generate Physically Realistic Full-body Motion for Virtual Reality Users".COMPUTER GRAPHICS FORUM 41.8(2022):183-194. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。