中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
Pose-Aware Attention Network for Flexible Motion Retargeting by Body Part

文献类型：期刊论文

作者Hu, Lei1,2; Zhang, Zihao1; Zhong, Chongyang1,2; Jiang, Boyuan1,2; Xia, Shihong1,2
刊名IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
出版日期2024-08-01
卷号30期号:8页码:4792-4808
关键词Deep learning motion processing motion retargeting
ISSN号1077-2626
DOI10.1109/TVCG.2023.3277918
英文摘要Motion retargeting is a fundamental problem in computer graphics and computer vision. Existing approaches usually have many strict requirements, such as the source-target skeletons needing to have the same number of joints or share the same topology. To tackle this problem, we note that skeletons with different structure may have some common body parts despite the differences in joint numbers. Following this observation, we propose a novel, flexible motion retargeting framework. The key idea of our method is to regard the body part as the basic retargeting unit rather than directly retargeting the whole body motion. To enhance the spatial modeling capability of the motion encoder, we introduce a pose-aware attention network (PAN) in the motion encoding phase. The PAN is pose-aware since it can dynamically predict the joint weights within each body part based on the input pose, and then construct a shared latent space for each body part by feature pooling. Extensive experiments show that our approach can generate better motion retargeting results both qualitatively and quantitatively than state-of-the-art methods. Moreover, we also show that our framework can generate reasonable results even for a more challenging retargeting scenario, like retargeting between bipedal and quadrupedal skeletons because of the body part retargeting strategy and PAN.
资助项目National Key R#x0026;D Program #x201C;Industrial Software#x201D; Special Project of China[2022YFB3303202]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:001262914400082
出版者IEEE COMPUTER SOC
源URL[http://119.78.100.204/handle/2XEOYT63/39858]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Xia, Shihong
作者单位1.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
2.Univ Chinese Acad Sci, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714		 Hu, Lei,Zhang, Zihao,Zhong, Chongyang,et al. Pose-Aware Attention Network for Flexible Motion Retargeting by Body Part[J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS,2024,30(8):4792-4808.
APA Hu, Lei,Zhang, Zihao,Zhong, Chongyang,Jiang, Boyuan,&Xia, Shihong.(2024).Pose-Aware Attention Network for Flexible Motion Retargeting by Body Part.IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS,30(8),4792-4808.
MLA Hu, Lei,et al."Pose-Aware Attention Network for Flexible Motion Retargeting by Body Part".IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 30.8(2024):4792-4808.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。