中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Pareidolia Face Reenactment

文献类型:会议论文

作者Song, Linsen3,4; Wu, Wayne1,2; Fu, Chaoyou3,4; Qian, Chen2; Loy, Chen Change1; He, Ran3,4
出版日期2021
会议日期2021.6.19
会议地点线上
英文摘要

We present a new application direction named Pareidolia Face Reenactment, which is defined as animating a static illusory face to move in tandem with a human face in the video. For the large differences between pareidolia face reenactment and traditional human face reenactment, two main challenges are introduced, i.e., shape variance and texture variance. In this work, we propose a novel Parametric Unsupervised Reenactment Algorithm to tackle these two challenges. Specifically, we propose to decompose the reenactment into three catenate processes: shape modeling, motion transfer and texture synthesis. With the decomposition, we introduce three crucial components, i.e., Parametric Shape Modeling, Expansionary Motion Transfer and Unsupervised Texture Synthesizer, to overcome the problems brought by the remarkably variances on pareidolia faces. Extensive experiments show the superior performance of our method both qualitatively and quantitatively. Code, model and data are available on our project page.

语种英语
源URL[http://ir.ia.ac.cn/handle/173211/48686]  
专题自动化研究所_智能感知与计算研究中心
通讯作者He, Ran
作者单位1.S-Lab, Nanyang Technological University
2.SenseTime Research
3.NLPR & CRIPAC, CASIA
4.School of Artificial Intelligence, University of Chinese Academy of Sciences
推荐引用方式
GB/T 7714
Song, Linsen,Wu, Wayne,Fu, Chaoyou,et al. Pareidolia Face Reenactment[C]. 见:. 线上. 2021.6.19.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。