中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A Unified Framework for Low-Latency Speaker Extraction in Cocktail Party Environments

文献类型:会议论文

作者Yunzhe Hao3,4; Jiaming Xu3,4; Jing Shi3,4; Peng Zhang3,4; Lei Qin1; Bo Xu2,3,4
出版日期2020-10
会议日期October 25–29, 2020
会议地点Shanghai, China
DOI10.21437/Interspeech.2020-208
英文摘要

Speech recognition technology in single-talker scenes has matured in recent years. However, in noisy environments, especially in multi-talker scenes, speech recognition performance is significantly reduced. Towards cocktail party problem, we propose a unified time-domain target speaker extraction framework. In this framework, we obtain a voiceprint from a clean speech of the target speaker and then extract the speech of the same speaker in a mixed speech based on the previously obtained voiceprint. This framework uses voiceprint information to avoid permutation problems. In addition, a time-domain model can avoid the phase reconstruction problem of traditional time-frequency domain models. Our framework is suitable for scenes where people are relatively fixed and their voiceprints are easily registered, such as in a car, home, meeting room, or other such scenes. The proposed global model based on the dual-path recurrent neural network (DPRNN) block achieved state-of-the-art under speaker extraction tasks on the WSJ0- 2mix dataset. We also built corresponding low-latency models. Results showed comparable model performance and a much shorter upper limit latency than time-frequency domain models. We found that performance of the low-latency model gradually decreased as latency decreased, which is important when deploying models in actual application scenarios.

会议录出版者INTERSPEECH
源URL[http://ir.ia.ac.cn/handle/173211/48880]  
专题数字内容技术与服务研究中心_听觉模型与认知计算
自动化研究所_数字内容技术与服务研究中心
通讯作者Jiaming Xu; Bo Xu
作者单位1.Huawei Consumer Business Group
2.Center for Excellence in Brain Science and Intelligence Technology, CAS, Beijing
3.University of Chinese Academy of Sciences, Beijing
4.Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing
推荐引用方式
GB/T 7714
Yunzhe Hao,Jiaming Xu,Jing Shi,et al. A Unified Framework for Low-Latency Speaker Extraction in Cocktail Party Environments[C]. 见:. Shanghai, China. October 25–29, 2020.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。