中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Remote Sensing Cross-Modal Retrieval by Deep Image-Voice Hashing

文献类型:期刊论文

作者Zhang, Yichao; Zheng, Xiangtao; Lu, Xiaoqiang
刊名IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING
出版日期2022
卷号15
ISSN号1939-1404;2151-1535
关键词Remote sensing Codes Feature extraction Image retrieval Semantics Task analysis Sensors Convolutional neural network (CNN) cross-modal retrieval deep hashing hash code
DOI10.1109/JSTARS.2022.3216333
产权排序1
英文摘要Remote sensing image retrieval aims at searching remote sensing images of interest among immense volumes of remote sensing data, which is an enormous challenge. Direct use of voice for human-computer interaction is more convenient and intelligent. In this article, a deep image-voice hashing (DIVH) method is proposed for remote sensing image-voice retrieval. First, the whole framework is composed of the image and the voice feature learning subnetwork. Then, the hash code learning procedure will be leveraged in remote sensing image-voice retrieval to further improve the retrieval efficiency and reduce memory footprint. Hash code learning maps the deep features of images and voices into a common Hamming space. Finally, image-voice pairwise loss is proposed, which considers the similarity preservation and balance of hash codes. The similarity preserving and the balance controlling term of the loss function improve the similarity preservation from original data space to the Hamming space and the discrimination of binary code, respectively. This unified cross-modal feature and hash code learning framework significantly reduce the semantic gap between the two modal data. Experiments demonstrate that the proposed DIVH method can achieve a superior retrieval performance than other state-of-the-art remote sensing image-voice retrieval methods.
语种英语
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号WOS:000883157900008
源URL[http://ir.opt.ac.cn/handle/181661/96242]  
专题西安光学精密机械研究所_光学影像学习与分析中心
推荐引用方式
GB/T 7714
Zhang, Yichao,Zheng, Xiangtao,Lu, Xiaoqiang. Remote Sensing Cross-Modal Retrieval by Deep Image-Voice Hashing[J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING,2022,15.
APA Zhang, Yichao,Zheng, Xiangtao,&Lu, Xiaoqiang.(2022).Remote Sensing Cross-Modal Retrieval by Deep Image-Voice Hashing.IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING,15.
MLA Zhang, Yichao,et al."Remote Sensing Cross-Modal Retrieval by Deep Image-Voice Hashing".IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING 15(2022).

入库方式: OAI收割

来源:西安光学精密机械研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。