中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Multilinear Multitask Learning by Rank-Product Regularization

文献类型:期刊论文

作者Zhao Q(赵谦)1; Rui, Xiangyu1; Han Z(韩志)3; Meng DY(孟德宇)1,3,4
刊名IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
出版日期2020
卷号31期号:4页码:1336-1350
关键词Multilinear multitask learning (MTL) rank product tensor sparsity
ISSN号2162-237X
产权排序2
英文摘要

Multilinear multitask learning (MLMTL) considers an MTL problem in which tasks are arranged by multiple indices. By exploiting the higher order correlations among the tasks, MLMTL is expected to improve the performance of traditional MTL, which only considers the first-order correlation across all tasks, e.g., low-rank structure of the coefficient matrix. The key to MLMTL is designing a rational regularization term to represent the latent correlation structure underlying the coefficient tensor instead of matrix. In this paper, we propose a new MLMTL model by employing the rank-product regularization term in the objective, which on one hand can automatically rectify the weights along all its tensor modes and on the other hand have an explicit physical meaning. By using this regularization, the intrinsic high-order correlations among tasks can be more precisely described, and thus, the overall performance of all tasks can be improved. To solve the resulted optimization model, we design an efficient algorithm by applying the alternating direction method of multipliers (ADMM). We also analyze the convergence and show that the proposed algorithm, with certain restriction, is asymptotically regular. Experiments on both synthetic and real data sets substantiate the superiority of the proposed method beyond the existing MLMTL methods in terms of accuracy and efficiency.

资助项目China NSFC Project[61603292] ; China NSFC Project[61661166011] ; China NSFC Project[11690011] ; China NSFC Project[61721002] ; China NSFC Project[61773367] ; China NSFC Project[U1811461] ; Youth Innovation Promotion Association of the Chinese Academy of Sciences[2016183] ; State Key Laboratory of Robotics[2017-O09]
WOS研究方向Computer Science ; Engineering
语种英语
WOS记录号WOS:000525351800022
资助机构China NSFC ProjectNational Natural Science Foundation of China [61603292, 61661166011, 11690011, 61721002, 61773367, U1811461] ; Youth Innovation Promotion Association of the Chinese Academy of Sciences [2016183] ; State Key Laboratory of Robotics [2017-O09]
源URL[http://ir.sia.cn/handle/173321/26724]  
专题沈阳自动化研究所_机器人学研究室
通讯作者Meng DY(孟德宇)
作者单位1.School of Mechanical Engineering, Shenyang Jianzhu University, Shenyang 110168, China
2.School of Electromechanical and Automotive Engineering, Yantai University, Yantai 264005, China
3.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
4.Department of Neurology, People's Hospital of Liaoning Province, Shenyang 110016, China
推荐引用方式
GB/T 7714
Zhao Q,Rui, Xiangyu,Han Z,et al. Multilinear Multitask Learning by Rank-Product Regularization[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2020,31(4):1336-1350.
APA Zhao Q,Rui, Xiangyu,Han Z,&Meng DY.(2020).Multilinear Multitask Learning by Rank-Product Regularization.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,31(4),1336-1350.
MLA Zhao Q,et al."Multilinear Multitask Learning by Rank-Product Regularization".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 31.4(2020):1336-1350.

入库方式: OAI收割

来源:沈阳自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。