中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A Speech-to-Hand Conversion System for Vowels and Nasals Based on Space Mapping

文献类型:期刊论文

作者Aki Kunikoshi; Yu Qiao; Daisuke Saito; Nobuaki Minematsu; Keikichi Hirose
刊名Journal of IPSJ
出版日期2012
英文摘要Synthesis methods which do not require symbol inputs, such as articulatory synthesis, are useful in continuous speech synthesis and pitch control based on dynamic body motion, in which there are no inherent symbols. Conventional applications based on these methods, however, are strongly dependent on their input media because those applications are designed to make use of their speci?c characteristics. Once an application is constructed for one media therefore, its methodology is di?cult to apply to another media. Considering this point, we treat speech generation from body motion as a mapping problem between different media, non-acoustic media to speech, and propose a media-independent methodology. As one example of our methodology, media conversion from hand motion to speech is discussed. In recent years, the GMM-based statistical mapping techniques have become widely used for voice conversion. Using similar techniques, we have developed a speech generation system which maps gesture space to vowel space and converts hand motions to vowel transitions. In this paper, we expand the system to nasal sound generation. In order to derive the gestures for nasals, a Speech-to-Hand conversion system was developed using the parallel data for vowels. Subjective evaluations showed that our proposed method is e?ective to generate more natural speech than the quasi-optimal design among a given gesture candidate set.
收录类别其他
原文出处https://ipsj.ixsq.nii.ac.jp/ej/?action=pages_view_main&active_action=repository_view_main_item_detail&item_id=83947&item_no=1&page_id=13&block_id=8
语种日文
源URL[http://ir.siat.ac.cn:8080/handle/172644/3686]  
专题深圳先进技术研究院_集成所
作者单位Journal of IPSJ
推荐引用方式
GB/T 7714
Aki Kunikoshi,Yu Qiao,Daisuke Saito,et al. A Speech-to-Hand Conversion System for Vowels and Nasals Based on Space Mapping[J]. Journal of IPSJ,2012.
APA Aki Kunikoshi,Yu Qiao,Daisuke Saito,Nobuaki Minematsu,&Keikichi Hirose.(2012).A Speech-to-Hand Conversion System for Vowels and Nasals Based on Space Mapping.Journal of IPSJ.
MLA Aki Kunikoshi,et al."A Speech-to-Hand Conversion System for Vowels and Nasals Based on Space Mapping".Journal of IPSJ (2012).

入库方式: OAI收割

来源:深圳先进技术研究院

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。