中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
WASE: LEARNING WHEN TO ATTEND FOR SPEAKER EXTRACTION IN COCKTAIL PARTY ENVIRONMENTS

文献类型:会议论文

作者Yunzhe Hao3,4; Jiaming Xu2,4; Peng Zhang2,4; Bo Xu2,3,4
出版日期2021-06
会议日期June 6-11, 2021
会议地点Toronto
DOI10.1109/ICASSP39728.2021.9413411
英文摘要

In the speaker extraction problem, it is found that additional information from the target speaker contributes to the tracking and extraction of the target speaker, which includes voiceprint, lip movement, facial expression, and spatial information. However, no one cares for the cue of sound onset, which has been emphasized in the auditory scene analysis and psychology. Inspired by it, we explicitly modeled the onset cue and verified the effectiveness in the speaker extraction task. We further extended to the onset/offset cues and got performance improvement. From the perspective of tasks, our onset/offset-based model completes the composite task, a complementary combination of speaker extraction and speaker-dependent voice activity detection. We also combined voiceprint with onset/offset cues. Voiceprint models voice characteristics of the target while onset/offset models the start/end information of the speech. From the perspective of auditory scene analysis, the combination of two perception cues can promote the integrity of the auditory object. The experiment results are also close to state-of-the-art performance, using nearly half of the parameters. We hope that this work will inspire communities of speech processing and psychology, and contribute to communication between them. Our code will be available in https: //github.com/aispeech-lab/wase/ .

会议录出版者IEEE
源URL[http://ir.ia.ac.cn/handle/173211/48874]  
专题数字内容技术与服务研究中心_听觉模型与认知计算
通讯作者Jiaming Xu; Bo Xu
作者单位1.Center for Excellence in Brain Science and Intelligence Technology, CAS, Beijing, China
2.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
3.School of Future Technology, University of Chinese Academy of Sciences, Beijing, China
4.Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing, China
推荐引用方式
GB/T 7714
Yunzhe Hao,Jiaming Xu,Peng Zhang,et al. WASE: LEARNING WHEN TO ATTEND FOR SPEAKER EXTRACTION IN COCKTAIL PARTY ENVIRONMENTS[C]. 见:. Toronto. June 6-11, 2021.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。