Multilinear Multitask Learning by Rank-Product Regularization
文献类型:期刊论文
作者 | Zhao Q(赵谦)1; Rui, Xiangyu1; Han Z(韩志)3![]() |
刊名 | IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
![]() |
出版日期 | 2020 |
卷号 | 31期号:4页码:1336-1350 |
关键词 | Multilinear multitask learning (MTL) rank product tensor sparsity |
ISSN号 | 2162-237X |
产权排序 | 2 |
英文摘要 | Multilinear multitask learning (MLMTL) considers an MTL problem in which tasks are arranged by multiple indices. By exploiting the higher order correlations among the tasks, MLMTL is expected to improve the performance of traditional MTL, which only considers the first-order correlation across all tasks, e.g., low-rank structure of the coefficient matrix. The key to MLMTL is designing a rational regularization term to represent the latent correlation structure underlying the coefficient tensor instead of matrix. In this paper, we propose a new MLMTL model by employing the rank-product regularization term in the objective, which on one hand can automatically rectify the weights along all its tensor modes and on the other hand have an explicit physical meaning. By using this regularization, the intrinsic high-order correlations among tasks can be more precisely described, and thus, the overall performance of all tasks can be improved. To solve the resulted optimization model, we design an efficient algorithm by applying the alternating direction method of multipliers (ADMM). We also analyze the convergence and show that the proposed algorithm, with certain restriction, is asymptotically regular. Experiments on both synthetic and real data sets substantiate the superiority of the proposed method beyond the existing MLMTL methods in terms of accuracy and efficiency. |
资助项目 | China NSFC Project[61603292] ; China NSFC Project[61661166011] ; China NSFC Project[11690011] ; China NSFC Project[61721002] ; China NSFC Project[61773367] ; China NSFC Project[U1811461] ; Youth Innovation Promotion Association of the Chinese Academy of Sciences[2016183] ; State Key Laboratory of Robotics[2017-O09] |
WOS研究方向 | Computer Science ; Engineering |
语种 | 英语 |
WOS记录号 | WOS:000525351800022 |
资助机构 | China NSFC ProjectNational Natural Science Foundation of China [61603292, 61661166011, 11690011, 61721002, 61773367, U1811461] ; Youth Innovation Promotion Association of the Chinese Academy of Sciences [2016183] ; State Key Laboratory of Robotics [2017-O09] |
源URL | [http://ir.sia.cn/handle/173321/26724] ![]() |
专题 | 沈阳自动化研究所_机器人学研究室 |
通讯作者 | Meng DY(孟德宇) |
作者单位 | 1.School of Mechanical Engineering, Shenyang Jianzhu University, Shenyang 110168, China 2.School of Electromechanical and Automotive Engineering, Yantai University, Yantai 264005, China 3.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China 4.Department of Neurology, People's Hospital of Liaoning Province, Shenyang 110016, China |
推荐引用方式 GB/T 7714 | Zhao Q,Rui, Xiangyu,Han Z,et al. Multilinear Multitask Learning by Rank-Product Regularization[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2020,31(4):1336-1350. |
APA | Zhao Q,Rui, Xiangyu,Han Z,&Meng DY.(2020).Multilinear Multitask Learning by Rank-Product Regularization.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,31(4),1336-1350. |
MLA | Zhao Q,et al."Multilinear Multitask Learning by Rank-Product Regularization".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 31.4(2020):1336-1350. |
入库方式: OAI收割
来源:沈阳自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。