A Model Compression Method With Matrix Product Operators for Speech Enhancement
文献类型：期刊论文
| 作者 | Xingwei Sun; Junfeng Li; Ze-Feng Gao; Zhong-Yi Lu; Junfeng Li; Yonghong Yan |
| 刊名 | IEEE/ACM Transactions on Audio, Speech, and Language Processing
 |
| 出版日期 | 2020 |
| 期号 | 1页码:2837 |
| ISSN号 | 2329-9290 |
| DOI | 10.1109/TASLP.2020.3030495 |
| 英文摘要 | The deep neural network (DNN) based speech enhancement approaches have achieved promising performance. However, the number of parameters involved in these methods is usually enormous for the real applications of speech enhancement on the device with the limited resources. This seriously restricts the applications. To deal with this issue, model compression techniques are being widely studied. In this paper, we propose a model compression method based on matrix product operators (MPO) to substantially reduce the number of parameters in DNN models for speech enhancement. In this method, the weight matrices in the linear transformations of neural network model are replaced by the MPO decomposition format before training. In experiment, this process is applied to the causal neural network models, such as the feedforward multilayer perceptron (MLP) and long short-term memory (LSTM) models. Both MLP and LSTM models with/without compression are then utilized to estimate the ideal ratio mask for monaural speech enhancement. The experimental results show that our proposed MPO-based method outperforms the widely-used pruning method for speech enhancement under various compression rates, and further improvement can be achieved with respect to low compression rates. Our proposal provides an effective model compression method for speech enhancement, especially in cloud-free application. |
| URL标识 | 查看原文 |
| 源URL | [http://159.226.59.140/handle/311008/9514]  |
| 专题 | 历年期刊论文_2020年期刊论文 |
| 作者单位 | 中国科学院声学研究所 |
| 推荐引用方式 GB/T 7714 | Xingwei Sun；Junfeng Li； Ze-Feng Gao； Zhong-Yi Lu； Junfeng Li； Yonghong Yan. A Model Compression Method With Matrix Product Operators for Speech Enhancement[J]. IEEE/ACM Transactions on Audio, Speech, and Language Processing,2020(1):2837. |
| APA | Xingwei Sun；Junfeng Li； Ze-Feng Gao； Zhong-Yi Lu； Junfeng Li； Yonghong Yan.(2020).A Model Compression Method With Matrix Product Operators for Speech Enhancement.IEEE/ACM Transactions on Audio, Speech, and Language Processing(1),2837. |
| MLA | Xingwei Sun；Junfeng Li； Ze-Feng Gao； Zhong-Yi Lu； Junfeng Li； Yonghong Yan."A Model Compression Method With Matrix Product Operators for Speech Enhancement".IEEE/ACM Transactions on Audio, Speech, and Language Processing .1(2020):2837. |
入库方式： OAI收割
来源：声学研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。