中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 合肥物质科学研究院
  3. 中国科学院合肥物质科学研究院
  4. 中科院合肥智能机械研究所
A realistic 3D articulatory animation system for emotional visual pronunciation

文献类型：期刊论文

作者Yu, Lingyun1; Yu, Jun1; Wang, Zengfu1,2
刊名MULTIMEDIA TOOLS AND APPLICATIONS
出版日期2017-09-01
卷号76期号:18页码:19241-19262
关键词Articulatory Movement Hidden Markov Model Fully Context-dependent Modeling Emotional Speech
DOI10.1007/s11042-017-4578-0
文献子类Article
英文摘要This paper proposes a realistic 3D articulatory animation system for emotional visual pronunciation driven by the emotional articulatory movement trajectory. Firstly, the articulatory movements, recorded by Electro-Magnetic Articulatory (EMA), are trained by Hidden Markov Model (HMM) while the fully context-dependent model is taken into account by making full use of the rich linguistic features. Secondly, owing to the independency in the manipulation of articulators, the articulatory movements are more remarkably adjusted to express different emotions. Thirdly, the emotional speech is generated by adjusting the neutral speech parameters, such as fundamental frequency (F0), duration and intensity, based on Praat. Then the corresponding articulatory movements are synthesized by the HMM prediction rules which are used to drive the head mesh model along with the emotional speech simultaneously. The experiments intend to synthesize accurate emotional speech synchronized animation of articulators based on the system at phoneme level.
WOS关键词SPEECH SYNTHESIS ; MOVEMENTS
WOS研究方向Computer Science ; Engineering
语种英语
WOS记录号WOS:000407861800050
资助机构National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; 61303150) ; 61303150)
源URL[http://ir.hfcas.ac.cn:8080/handle/334002/33566]  
专题合肥物质科学研究院_中科院合肥智能机械研究所
作者单位1.Univ Sci & Technol China, Dept Automat, Hefei, Anhui, Peoples R China
2.Chinese Acad Sci, Inst Intelligent Machines, Hefei, Anhui, Peoples R China
推荐引用方式
GB/T 7714		 Yu, Lingyun,Yu, Jun,Wang, Zengfu. A realistic 3D articulatory animation system for emotional visual pronunciation[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2017,76(18):19241-19262.
APA Yu, Lingyun,Yu, Jun,&Wang, Zengfu.(2017).A realistic 3D articulatory animation system for emotional visual pronunciation.MULTIMEDIA TOOLS AND APPLICATIONS,76(18),19241-19262.
MLA Yu, Lingyun,et al."A realistic 3D articulatory animation system for emotional visual pronunciation".MULTIMEDIA TOOLS AND APPLICATIONS 76.18(2017):19241-19262.

入库方式： OAI收割

来源：合肥物质科学研究院

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。