Gesture Design of Hand-to-Speech Conversion Based on Probabilistic Integration of Speech-to-Hand Joint Density Model and Hand Gesture Model
文献类型：会议论文
| 作者 | A. KUNIKOSHI; D. SAITO; Y. QIAO; N. MINEMATSU; K. HIROSE |
| 出版日期 | 2011 |
| 会议名称 | IEICE technical report |
| 英文摘要 | When individuals with speaking disabilities, dysarthrics, try to communicate using speech, they often have to use speech synthesizers which require them to type word symbols or sound symbols. This input method often makes realtime operations difficult and dysarthric users fail to control the flow of conversation. In this study,we are developing a new and novel speech synthesizer where not symbol inputs but hand motions are used to generate speech. In recent years, statistical mapping techniques have been proposed for voice conversion. Based on these methods, we developed a system to convert hand motions to vowel transitions by finding the mapping between a hand space and a vowel space. We found that the proposed method was effective to generate utterances of Japanese five vowels. In this paper, we discuss how to extend this system for consonant generation. We develop a Speech-to-Hand conversion system trained from parallel data for vowels only to infer the gestures corresponding to consonants. |
| 收录类别 | 其他 |
| 语种 | 日文 |
| 源URL | [http://ir.siat.ac.cn:8080/handle/172644/3266]  |
| 专题 | 深圳先进技术研究院_集成所 |
| 作者单位 | 2011 |
| 推荐引用方式 GB/T 7714 | A. KUNIKOSHI,D. SAITO,Y. QIAO,et al. Gesture Design of Hand-to-Speech Conversion Based on Probabilistic Integration of Speech-to-Hand Joint Density Model and Hand Gesture Model[C]. 见:IEICE technical report. |
入库方式： OAI收割
来源：深圳先进技术研究院
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。