Deep Binary Reconstruction for Cross-Modal Hashing
文献类型:期刊论文
作者 | Hu, Di1; Nie, Feiping1; Li, Xuelong2,3,4 |
刊名 | IEEE TRANSACTIONS ON MULTIMEDIA |
出版日期 | 2019-04 |
卷号 | 21期号:4页码:973-985 |
ISSN号 | 1520-9210;1941-0077 |
关键词 | Cross-modal hashing binary reconstruction |
DOI | 10.1109/TMM.2018.2866771 |
产权排序 | 4 |
英文摘要 | To satisfy the huge storage space and organization capacity requirements in addressing big multimodal data, hashing techniques have been widely employed to learn binary representations in cross-modal retrieval tasks. However, optimizing the hashing objective under the necessary binary constraint is truly a difficult problem. A common strategy is to relax the constraint and perform individual binarizations over the learned real-valued representations. In this paper, in contrast to conventional two-stage methods, we propose to directly learn the binary codes, where the model can be easily optimized by a standard gradient descent optimizer. However, before that, we present a theoretical guarantee of the effectiveness of the multimodal network in preserving the inter-and intra-modal consistencies. Based on this guarantee, a novel multimodal deep binary reconstruction model is proposed, which can be trained to simultaneously model the correlation across modalities and learn the binary hashing codes. To generate binary codes and to avoid the tiny gradient problem, a novel activation function first scales the input activations to suitable scopes and, then, feeds them to the tanh function to build the hashing layer. Such a composite function is named adaptive tanh. Both linear and nonlinear scaling methods are proposed and shown to generate efficient codes after training the network. Extensive ablation studies and comparison experiments are conducted for the image2text and text2image retrieval tasks; the method is found to outperform several state-of-the-art deep-learning methods with respect to different evaluation metrics. |
语种 | 英语 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
WOS记录号 | WOS:000462413700013 |
源URL | [http://ir.opt.ac.cn/handle/181661/31355] |
专题 | 西安光学精密机械研究所_光学影像学习与分析中心 |
通讯作者 | Hu, Di |
作者单位 | 1.Northwestern Polytech Univ, Sch Comp Sci & Engn, Xian 710072, Shaanxi, Peoples R China 2.Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Shaanxi, Peoples R China 3.Northwestern Polytech Univ, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710072, Shaanxi, Peoples R China 4.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China |
推荐引用方式 GB/T 7714 | Hu, Di,Nie, Feiping,Li, Xuelong. Deep Binary Reconstruction for Cross-Modal Hashing[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2019,21(4):973-985. |
APA | Hu, Di,Nie, Feiping,&Li, Xuelong.(2019).Deep Binary Reconstruction for Cross-Modal Hashing.IEEE TRANSACTIONS ON MULTIMEDIA,21(4),973-985. |
MLA | Hu, Di,et al."Deep Binary Reconstruction for Cross-Modal Hashing".IEEE TRANSACTIONS ON MULTIMEDIA 21.4(2019):973-985. |
入库方式: OAI收割
来源:西安光学精密机械研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。