Spectral Token Guidance Transformer for Multisource Images Change Detection
文献类型:期刊论文
作者 | Sun, Bangyong5,6; Liu, Qinsen6; Yuan, Nianzeng6; Tan, Jiahai3,4; Gao, Xiaomei2; Yu, Tao1 |
刊名 | IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING |
出版日期 | 2023 |
卷号 | 16页码:2559-2572 |
ISSN号 | 1939-1404;2151-1535 |
关键词 | Transformers Feature extraction Task analysis Adaptive systems Adaptation models Optics Sun Change detection (CD) heterogeneous images hyperspectral images multispectral images transformer |
DOI | 10.1109/JSTARS.2023.3251962 |
产权排序 | 4 |
英文摘要 | With the development of Earth observation technology, more multisource remote sensing images are obtained from various satellite sensors and significantly enrich the data source of change detection (CD). However, the utilization of multisource bitemporal images frequently introduces challenges during featuring or representing the various physical mechanisms of the observed landscapes and makes it more difficult to develop a general model for homogeneous and heterogeneous CD adaptively. In this article, we propose an adaptive spatial-spectral transformer CD network based on spectral token guidance, named STCD-Former. Specifically, a spectral transformer with dual-branch first encodes the diverse spectral sequence in spectral-wise to generate a corresponding spectral token. And then, the spectral token is used as guidance to interact with the patch token to learn the change rules. More significantly, to optimize the learning of difference information, we design a difference amplification module to highlight discriminative features by adaptively integrating the difference information into the feature embedding. Finally, the binary CD result is obtained by multilayer perceptron. The experimental results on three homogeneous datasets and one heterogeneous dataset have demonstrated that the proposed STCD-Former outperforms the other state-of-the-art methods qualitatively and visually. |
语种 | 英语 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
WOS记录号 | WOS:000957626900003 |
源URL | [http://ir.opt.ac.cn/handle/181661/96428] |
专题 | 西安光学精密机械研究所_光学影像学习与分析中心 |
通讯作者 | Yu, Tao |
作者单位 | 1.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Key Lab Spectral Imaging Technol CAS, Xian 710119, Peoples R China 2.China Natl Adm Coal Geol, Mapping & Printing, Xian 710199, Peoples R China 3.Chinese Acad Sci, Xian Inst Opt & Precis Mech, State Key Lab Transient Opt & Photon, Xian 710119, Peoples R China 4.Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China 5.Qilu Univ Technol, Shandong Acad Sci, Key Lab Pulp & Paper Sci & Technol, Minist Educ, Jinan 250316, Peoples R China 6.Xian Univ Technol, Sch Printing Packaging & Digital Media, Xian 710048, Peoples R China |
推荐引用方式 GB/T 7714 | Sun, Bangyong,Liu, Qinsen,Yuan, Nianzeng,et al. Spectral Token Guidance Transformer for Multisource Images Change Detection[J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING,2023,16:2559-2572. |
APA | Sun, Bangyong,Liu, Qinsen,Yuan, Nianzeng,Tan, Jiahai,Gao, Xiaomei,&Yu, Tao.(2023).Spectral Token Guidance Transformer for Multisource Images Change Detection.IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING,16,2559-2572. |
MLA | Sun, Bangyong,et al."Spectral Token Guidance Transformer for Multisource Images Change Detection".IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING 16(2023):2559-2572. |
入库方式: OAI收割
来源:西安光学精密机械研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。