WASE: LEARNING WHEN TO ATTEND FOR SPEAKER EXTRACTION IN COCKTAIL PARTY ENVIRONMENTS
文献类型:会议论文
作者 | Yunzhe Hao3,4![]() ![]() ![]() ![]() |
出版日期 | 2021-06 |
会议日期 | June 6-11, 2021 |
会议地点 | Toronto |
DOI | 10.1109/ICASSP39728.2021.9413411 |
英文摘要 | In the speaker extraction problem, it is found that additional information from the target speaker contributes to the tracking and extraction of the target speaker, which includes voiceprint, lip movement, facial expression, and spatial information. However, no one cares for the cue of sound onset, which has been emphasized in the auditory scene analysis and psychology. Inspired by it, we explicitly modeled the onset cue and verified the effectiveness in the speaker extraction task. We further extended to the onset/offset cues and got performance improvement. From the perspective of tasks, our onset/offset-based model completes the composite task, a complementary combination of speaker extraction and speaker-dependent voice activity detection. We also combined voiceprint with onset/offset cues. Voiceprint models voice characteristics of the target while onset/offset models the start/end information of the speech. From the perspective of auditory scene analysis, the combination of two perception cues can promote the integrity of the auditory object. The experiment results are also close to state-of-the-art performance, using nearly half of the parameters. We hope that this work will inspire communities of speech processing and psychology, and contribute to communication between them. Our code will be available in https: //github.com/aispeech-lab/wase/ . |
会议录出版者 | IEEE |
源URL | [http://ir.ia.ac.cn/handle/173211/48874] ![]() |
专题 | 数字内容技术与服务研究中心_听觉模型与认知计算 |
通讯作者 | Jiaming Xu; Bo Xu |
作者单位 | 1.Center for Excellence in Brain Science and Intelligence Technology, CAS, Beijing, China 2.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China 3.School of Future Technology, University of Chinese Academy of Sciences, Beijing, China 4.Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing, China |
推荐引用方式 GB/T 7714 | Yunzhe Hao,Jiaming Xu,Peng Zhang,et al. WASE: LEARNING WHEN TO ATTEND FOR SPEAKER EXTRACTION IN COCKTAIL PARTY ENVIRONMENTS[C]. 见:. Toronto. June 6-11, 2021. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。