A Unified Framework for Low-Latency Speaker Extraction in Cocktail Party Environments
文献类型:会议论文
作者 | Yunzhe Hao3,4![]() ![]() ![]() ![]() ![]() |
出版日期 | 2020-10 |
会议日期 | October 25–29, 2020 |
会议地点 | Shanghai, China |
DOI | 10.21437/Interspeech.2020-208 |
英文摘要 | Speech recognition technology in single-talker scenes has matured in recent years. However, in noisy environments, especially in multi-talker scenes, speech recognition performance is significantly reduced. Towards cocktail party problem, we propose a unified time-domain target speaker extraction framework. In this framework, we obtain a voiceprint from a clean speech of the target speaker and then extract the speech of the same speaker in a mixed speech based on the previously obtained voiceprint. This framework uses voiceprint information to avoid permutation problems. In addition, a time-domain model can avoid the phase reconstruction problem of traditional time-frequency domain models. Our framework is suitable for scenes where people are relatively fixed and their voiceprints are easily registered, such as in a car, home, meeting room, or other such scenes. The proposed global model based on the dual-path recurrent neural network (DPRNN) block achieved state-of-the-art under speaker extraction tasks on the WSJ0- 2mix dataset. We also built corresponding low-latency models. Results showed comparable model performance and a much shorter upper limit latency than time-frequency domain models. We found that performance of the low-latency model gradually decreased as latency decreased, which is important when deploying models in actual application scenarios. |
会议录出版者 | INTERSPEECH |
源URL | [http://ir.ia.ac.cn/handle/173211/48880] ![]() |
专题 | 数字内容技术与服务研究中心_听觉模型与认知计算 自动化研究所_数字内容技术与服务研究中心 |
通讯作者 | Jiaming Xu; Bo Xu |
作者单位 | 1.Huawei Consumer Business Group 2.Center for Excellence in Brain Science and Intelligence Technology, CAS, Beijing 3.University of Chinese Academy of Sciences, Beijing 4.Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing |
推荐引用方式 GB/T 7714 | Yunzhe Hao,Jiaming Xu,Jing Shi,et al. A Unified Framework for Low-Latency Speaker Extraction in Cocktail Party Environments[C]. 见:. Shanghai, China. October 25–29, 2020. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。