中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
ACWCD: Utilizing Inherent Transformers Information and Prior Knowledge for Weakly Supervised Change Detection

文献类型:期刊论文

作者Liu, Wenhao2,3; Yu, Zhuoyuan2,3; Luo, Bin1,3
刊名IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
出版日期2025
卷号63页码:4402614
关键词Cams Transformers Feature extraction Neural networks Training Data mining Remote sensing Refining Deep learning Decoding Change detection (CD) class activation maps (CAMs) deep learning high-resolution images multihead self-attention (MHSA) prior knowledge transformers weakly supervised learning
ISSN号0196-2892
DOI10.1109/TGRS.2025.3527009
产权排序1
文献子类Article
英文摘要Change detection (CD) using deep learning is crucial for analyzing changes on the Earth's surface. Yet, obtaining accurate, extensive pixel-level labels is difficult and time-consuming. Consequently, there is growing interest in weakly supervised CD (WSCD) using image-level labels, praised for its high efficiency in label acquisition. Nonetheless, the lack of adequate supervision leads many existing WSCD methods to adopt intricate processes, neglecting the inherent information present in the networks. To overcome these challenges, we propose ACWCD, an end-to-end encoder-decoder framework based on transformers for WSCD using image-level labels. The proposed framework is primarily designed for vision transformer (ViT)-related backbones. It generates effective pseudo labels by tapping into the localizing prowess of class activation maps (CAMs) and simultaneously utilizes these labels for pixel-level supervision during training. Specifically, ACWCD comprises two pivotal components: the attention refinement (AR) module and the change priori (CP) constraint. By harnessing the inherent multihead self-attention (MHSA) of transformers, the AR module refines CAMs by producing change attention from MHSA, thereby refining the pseudo labels. Furthermore, utilizing prior knowledge, the CP constraint prevents the AR module from processing samples with unchanged image-level labels, thus addressing the issue of AR generating spurious change areas. In addition, an exclusive threshold is assigned to each pair of images to help differentiate pseudo labels. It also imposes penalties based on the proportion of mispredictions using the designed plug-and-play loss function. To validate the performance of ACWCD, experiments are conducted on three high-resolution remote sensing datasets. The outcomes reveal that the proposed framework not only achieves new state-of-the-art (SOTA) performance within the WSCD domain but also exhibits substantial scalability, as it does not involve any complex processes, serving as a useful baseline for future research. The code is available at https://github.com/WenhaoLiu03/ACWCD.
URL标识查看原文
WOS关键词NETWORK ; MODEL
WOS研究方向Geochemistry & Geophysics ; Engineering ; Remote Sensing ; Imaging Science & Photographic Technology
语种英语
WOS记录号WOS:001414425700003
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
源URL[http://ir.igsnrr.ac.cn/handle/311030/212407]  
专题资源与环境信息系统国家重点实验室_外文论文
通讯作者Yu, Zhuoyuan
作者单位1.Beijing Starearth Technol Co Ltd, Beijing 100083, Peoples R China
2.Univ Chinese Acad Sci, Coll Resource & Environm, Beijing 100049, Peoples R China;
3.Chinese Acad Sci, Inst Geog Sci & Nat Resources Res, State Key Lab Resources & Environm Informat Syst, Beijing 100101, Peoples R China;
推荐引用方式
GB/T 7714
Liu, Wenhao,Yu, Zhuoyuan,Luo, Bin. ACWCD: Utilizing Inherent Transformers Information and Prior Knowledge for Weakly Supervised Change Detection[J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING,2025,63:4402614.
APA Liu, Wenhao,Yu, Zhuoyuan,&Luo, Bin.(2025).ACWCD: Utilizing Inherent Transformers Information and Prior Knowledge for Weakly Supervised Change Detection.IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING,63,4402614.
MLA Liu, Wenhao,et al."ACWCD: Utilizing Inherent Transformers Information and Prior Knowledge for Weakly Supervised Change Detection".IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 63(2025):4402614.

入库方式: OAI收割

来源:地理科学与资源研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。