Unconstrained Multimodal Multi-Label Learning
文献类型：期刊论文
| 作者 | Huang, Yan1 ; Wang, Wei1; Wang, Liang1,2
|
| 刊名 | IEEE TRANSACTIONS ON MULTIMEDIA
 |
| 出版日期 | 2015-11-01 |
| 卷号 | 17期号:11页码:1923-1935 |
| 关键词 | Multi-label learning multi-task learning multimodal learning restricted Boltzmann machine |
| 英文摘要 | Multimodal learning has been mostly studied by assuming that multiple label assignments are independent of each other and all the modalities are available. In this paper, we consider a more general problem where the labels contain dependency relationships and some modalities are likely to be missing. To this end, we propose a multi-label conditional restricted Boltzmann machine (ML-CRBM), which handles modality completion, fusion, and multi-label prediction in a unified framework. The proposed model is able to generate missing modalities based on observed ones, by explicitly modelling and sampling their conditional distributions. After that, it can discriminatively fuse multiple modalities to obtain shared representations under the supervision of class labels. To consider the co-occurrence of the labels, the proposed model formulates the multi-label prediction as a max-margin-based multi-task learning problem. Model parameters can be jointly learned by seeking a balance between being generative for modality generation and being discriminative for label prediction. We perform a series of experiments in terms of classification, visualization, and retrieval, and the experimental results clearly demonstrate the effectiveness of our method. |
| WOS标题词 | Science & Technology ; Technology |
| 类目[WOS] | Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications |
| 研究领域[WOS] | Computer Science ; Telecommunications |
| 关键词[WOS] | NEURAL-NETWORKS ; REPRESENTATION ; COLOR |
| 收录类别 | SCI |
| 语种 | 英语 |
| WOS记录号 | WOS:000364102400006 |
| 公开日期 | 2016-02-26 |
| 源URL | [http://ir.ia.ac.cn/handle/173211/10497]  |
| 专题 | 自动化研究所_智能感知与计算研究中心 |
| 作者单位 | 1.Chinese Acad Sci CASIA, Inst Automat, Natl Lab Pattern Recognit, Ctr Res Intelligent Percept & Comp, Beijing 100190, Peoples R China 2.CASIA, Inst Automat, CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China |
| 推荐引用方式 GB/T 7714 | Huang, Yan,Wang, Wei,Wang, Liang. Unconstrained Multimodal Multi-Label Learning[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2015,17(11):1923-1935. |
| APA | Huang, Yan,Wang, Wei,&Wang, Liang.(2015).Unconstrained Multimodal Multi-Label Learning.IEEE TRANSACTIONS ON MULTIMEDIA,17(11),1923-1935. |
| MLA | Huang, Yan,et al."Unconstrained Multimodal Multi-Label Learning".IEEE TRANSACTIONS ON MULTIMEDIA 17.11(2015):1923-1935. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。