中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A universal adapter in segmentation models for transferable landslide mapping

文献类型:期刊论文

作者Wei, Ruilong6,7; Li, Yamei5; Li, Yao4; Zhang, Bo7; Wang, Jiao7; Wu, Chunhao7; Yao, Shunyu2,3; Ye, Chengming1
刊名ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING
出版日期2024-12-01
卷号218页码:446-465
关键词Deep learning Transfer learning Landslide mapping Tibetan Plateau
ISSN号0924-2716
DOI10.1016/j.isprsjprs.2024.11.006
英文摘要

Efficient landslide mapping is crucial for disaster mitigation and relief. Recently, deep learning methods have shown promising results in landslide mapping using satellite imagery. However, the sample sparsity and geographic diversity of landslides have challenged the transferability of deep learning models. In this paper, we proposed a universal adapter module that can be seamlessly embedded into existing segmentation models for transferable landslide mapping. The adapter can achieve high-accuracy cross-regional landslide segmentation with a small sample set, requiring minimal parameter adjustments. In detail, the pre-trained baseline model freezes its parameters to keep learned knowledge of the source domain, while the lightweight adapter fine-tunes only a few parameters to learn new landslide features of the target domain. Structurally, we introduced an attention mechanism to enhance the feature extraction of the adapter. To validate the proposed adapter module, 4321 landslide samples were prepared, and the Segment Anything Model (SAM) and other baseline models, along with four transfer strategies were selected for controlled experiments. In addition, Sentinel-2 satellite imagery in the Himalayas and Hengduan Mountains, located on the southern and southeastern edges of the Tibetan Plateau was collected for evaluation. The controlled experiments reported that SAM, when combined with our adapter module, achieved a peak mean Intersection over Union (mIoU) of 82.3 %. For other baseline models, integrating the adapter improved mIoU by 2.6 % to 12.9 % compared with traditional strategies on cross-regional landslide mapping. In particular, baseline models with Transformers are more suitable for finetuning parameters. Furthermore, the visualized feature maps revealed that fine-tuning shallow encoders can achieve better effects in model transfer. Besides, the proposed adapter can effectively extract landslide features and focus on specific spatial and channel domains with significant features. We also quantified the spectral, scale, and shape features of landslides and analyzed their impacts on segmentation results. Our analysis indicated that weak spectral differences, as well as extreme scale and edge shapes are detrimental to the accuracy of landslide segmentation. Overall, this adapter module provides a new perspective for large-scale transferable landslide mapping.

WOS关键词IMAGES
资助项目National Natural Science Foundation of China[42201082] ; National Natural Science Foundation of China[42071411] ; Second Tibetan Plateau Scientific Expedition and Research Program (STEP)[2019QZKK0902] ; China Postdoctoral Science Foundation[2023M731874]
WOS研究方向Physical Geography ; Geology ; Remote Sensing ; Imaging Science & Photographic Technology
语种英语
WOS记录号WOS:001359264800001
出版者ELSEVIER
资助机构National Natural Science Foundation of China ; Second Tibetan Plateau Scientific Expedition and Research Program (STEP) ; China Postdoctoral Science Foundation
源URL[http://ir.imde.ac.cn/handle/131551/58541]  
专题成都山地灾害与环境研究所_山地灾害与地表过程重点实验室
通讯作者Li, Yamei
作者单位1.Chengdu Univ Technol, Key Lab Earth Explorat & Informat Technol, Minist Educ, Chengdu 610059, Peoples R China
2.Minist Water Resources, Res Ctr Flood & Drought Disaster Reduct, Beijing 100038, Peoples R China
3.China Inst Water Resources & Hydropower Res, Beijing 100038, Peoples R China
4.Tsinghua Univ, State Key Lab Hydrosci & Engn, Beijing 100084, Peoples R China
5.Chinese Acad Sci, Inst Tibetan Plateau Res, State Key Lab Tibetan Plateau Earth Syst Environm, Beijing 100101, Peoples R China
6.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
7.Chinese Acad Sci, Inst Mt Hazards & Environm, Key Lab Mt Hazards & Earth Surface Proc, Chengdu 610041, Peoples R China
推荐引用方式
GB/T 7714
Wei, Ruilong,Li, Yamei,Li, Yao,et al. A universal adapter in segmentation models for transferable landslide mapping[J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING,2024,218:446-465.
APA Wei, Ruilong.,Li, Yamei.,Li, Yao.,Zhang, Bo.,Wang, Jiao.,...&Ye, Chengming.(2024).A universal adapter in segmentation models for transferable landslide mapping.ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING,218,446-465.
MLA Wei, Ruilong,et al."A universal adapter in segmentation models for transferable landslide mapping".ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING 218(2024):446-465.

入库方式: OAI收割

来源:成都山地灾害与环境研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。