Boosting deep cross-modal retrieval hashing with adversarially robust training
文献类型:期刊论文
作者 | Zhang, Xingwei1,2; Zheng, Xiaolong1,2; Mao, Wenji1,2; Zeng, Daniel Dajun1,2 |
刊名 | APPLIED INTELLIGENCE |
出版日期 | 2023-07-13 |
页码 | 13 |
ISSN号 | 0924-669X |
关键词 | Cross-modal retrieval Adversarial training Deep hashing model Deep neural network |
DOI | 10.1007/s10489-023-04715-0 |
通讯作者 | Zheng, Xiaolong(xiaolong.zheng@ia.ac.cn) |
英文摘要 | Deep hashing methods effectively enhance the performance of conventional machine learning retrieval models, particularly in visual medium evolving cross-modal retrieval tasks, by relying on the outstanding feature extraction ability of deep neural networks (DNNs). The state-of-the-art deep hashing research focuses on designing prominent models by employing DNNs to discover semantic information from different modalities of data and execute relevant information retrieval tasks. However, the robustness attribute considered essential for reliable DNN model design has limited concerns on deep hashing models. In this article, we present an end-to-end adversarial training framework for cross-modal retrieval. Our framework leverages a projected gradient descent(PGD)-based method to generate adversarial samples, which are then combined with normal samples to achieve robust training. Our approach addresses the vulnerability issues of existing cross-modal retrieval models and fills the gap in retrieval task design. We conduct extensive experiments and compare our model with state-of-the-art cross-modal retrieval models on three benchmark datasets to verify that our model can effectively boost the performance of deep hashing retrieval models on cross-modal retrieval . This work highlights the effectiveness of adversarial training in efficient deep hashing model design. |
资助项目 | Ministry of Science and Technology of China[:2020AAA0108401] ; Natural Science Foundation of China[72225011] ; Natural Science Foundation of China[71621002] |
WOS研究方向 | Computer Science |
语种 | 英语 |
出版者 | SPRINGER |
WOS记录号 | WOS:001027468800010 |
资助机构 | Ministry of Science and Technology of China ; Natural Science Foundation of China |
源URL | [http://ir.ia.ac.cn/handle/173211/53759] |
专题 | 舆论大数据科学与技术应用联合实验室 |
通讯作者 | Zheng, Xiaolong |
作者单位 | 1.Chinese Acad Sci, Inst Automat, 95 Zhongguancun East Rd, Beijing 100053, Peoples R China 2.Univ Chinese Acad Sci, Sch Artificial Intelligence, 19 Yuquan Rd, Beijing 100049, Peoples R China |
推荐引用方式 GB/T 7714 | Zhang, Xingwei,Zheng, Xiaolong,Mao, Wenji,et al. Boosting deep cross-modal retrieval hashing with adversarially robust training[J]. APPLIED INTELLIGENCE,2023:13. |
APA | Zhang, Xingwei,Zheng, Xiaolong,Mao, Wenji,&Zeng, Daniel Dajun.(2023).Boosting deep cross-modal retrieval hashing with adversarially robust training.APPLIED INTELLIGENCE,13. |
MLA | Zhang, Xingwei,et al."Boosting deep cross-modal retrieval hashing with adversarially robust training".APPLIED INTELLIGENCE (2023):13. |
入库方式: OAI收割
来源:自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。