中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Cross-Modal Subspace Learning via Pairwise Constraints

文献类型:期刊论文

作者He, Ran1; Zhang, Man1; Wang, Liang1; Ji, Ye2; Yin, Qiyue1; Ran He(赫然); Liang Wang; Man Zhang; Qiyue Yin
刊名IEEE TRANSACTIONS ON IMAGE PROCESSING
出版日期2015-12-01
卷号24期号:12页码:5543-5556
关键词Multi modal pairwise constraint subspace clustering
英文摘要In multimedia applications, the text and image components in a web document form a pairwise constraint that potentially indicates the same semantic concept. This paper studies cross-modal learning via the pairwise constraint and aims to find the common structure hidden in different modalities. We first propose a compound regularization framework to address the pairwise constraint, which can be used as a general platform for developing cross-modal algorithms. For unsupervised learning, we propose a multi-modal subspace clustering method to learn a common structure for different modalities. For supervised learning, to reduce the semantic gap and the outliers in pairwise constraints, we propose a cross-modal matching method based on compound l(21) regularization. Extensive experiments demonstrate the benefits of joint text and image modeling with semantically induced pairwise constraints, and they show that the proposed cross-modal methods can further reduce the semantic gap between different modalities and improve the clustering/matching accuracy.
WOS标题词Science & Technology ; Technology
类目[WOS]Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
研究领域[WOS]Computer Science ; Engineering
关键词[WOS]DIMENSIONALITY REDUCTION ; MULTIVIEW DATA ; IMAGE ; FRAMEWORK ; FUSION ; STYLE ; RANK
收录类别SCI
语种英语
WOS记录号WOS:000363251800008
公开日期2016-02-26
源URL[http://ir.ia.ac.cn/handle/173211/10492]  
专题自动化研究所_智能感知与计算研究中心
作者单位1.Chinese Acad Sci, Inst Automat, Ctr Res Intelligent Percept & Comp, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
2.Shandong Univ, Dept Control Sci & Engn, Jinan 250100, Peoples R China
推荐引用方式
GB/T 7714
He, Ran,Zhang, Man,Wang, Liang,et al. Cross-Modal Subspace Learning via Pairwise Constraints[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2015,24(12):5543-5556.
APA He, Ran.,Zhang, Man.,Wang, Liang.,Ji, Ye.,Yin, Qiyue.,...&Qiyue Yin.(2015).Cross-Modal Subspace Learning via Pairwise Constraints.IEEE TRANSACTIONS ON IMAGE PROCESSING,24(12),5543-5556.
MLA He, Ran,et al."Cross-Modal Subspace Learning via Pairwise Constraints".IEEE TRANSACTIONS ON IMAGE PROCESSING 24.12(2015):5543-5556.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。