A universal adapter in segmentation models for transferable landslide mapping
文献类型:期刊论文
作者 | Wei, Ruilong6,7; Li, Yamei5; Li, Yao4; Zhang, Bo7; Wang, Jiao7![]() ![]() |
刊名 | ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING
![]() |
出版日期 | 2024-12-01 |
卷号 | 218页码:446-465 |
关键词 | Deep learning Transfer learning Landslide mapping Tibetan Plateau |
ISSN号 | 0924-2716 |
DOI | 10.1016/j.isprsjprs.2024.11.006 |
英文摘要 | Efficient landslide mapping is crucial for disaster mitigation and relief. Recently, deep learning methods have shown promising results in landslide mapping using satellite imagery. However, the sample sparsity and geographic diversity of landslides have challenged the transferability of deep learning models. In this paper, we proposed a universal adapter module that can be seamlessly embedded into existing segmentation models for transferable landslide mapping. The adapter can achieve high-accuracy cross-regional landslide segmentation with a small sample set, requiring minimal parameter adjustments. In detail, the pre-trained baseline model freezes its parameters to keep learned knowledge of the source domain, while the lightweight adapter fine-tunes only a few parameters to learn new landslide features of the target domain. Structurally, we introduced an attention mechanism to enhance the feature extraction of the adapter. To validate the proposed adapter module, 4321 landslide samples were prepared, and the Segment Anything Model (SAM) and other baseline models, along with four transfer strategies were selected for controlled experiments. In addition, Sentinel-2 satellite imagery in the Himalayas and Hengduan Mountains, located on the southern and southeastern edges of the Tibetan Plateau was collected for evaluation. The controlled experiments reported that SAM, when combined with our adapter module, achieved a peak mean Intersection over Union (mIoU) of 82.3 %. For other baseline models, integrating the adapter improved mIoU by 2.6 % to 12.9 % compared with traditional strategies on cross-regional landslide mapping. In particular, baseline models with Transformers are more suitable for finetuning parameters. Furthermore, the visualized feature maps revealed that fine-tuning shallow encoders can achieve better effects in model transfer. Besides, the proposed adapter can effectively extract landslide features and focus on specific spatial and channel domains with significant features. We also quantified the spectral, scale, and shape features of landslides and analyzed their impacts on segmentation results. Our analysis indicated that weak spectral differences, as well as extreme scale and edge shapes are detrimental to the accuracy of landslide segmentation. Overall, this adapter module provides a new perspective for large-scale transferable landslide mapping. |
WOS关键词 | IMAGES |
资助项目 | National Natural Science Foundation of China[42201082] ; National Natural Science Foundation of China[42071411] ; Second Tibetan Plateau Scientific Expedition and Research Program (STEP)[2019QZKK0902] ; China Postdoctoral Science Foundation[2023M731874] |
WOS研究方向 | Physical Geography ; Geology ; Remote Sensing ; Imaging Science & Photographic Technology |
语种 | 英语 |
WOS记录号 | WOS:001359264800001 |
出版者 | ELSEVIER |
资助机构 | National Natural Science Foundation of China ; Second Tibetan Plateau Scientific Expedition and Research Program (STEP) ; China Postdoctoral Science Foundation |
源URL | [http://ir.imde.ac.cn/handle/131551/58541] ![]() |
专题 | 成都山地灾害与环境研究所_山地灾害与地表过程重点实验室 |
通讯作者 | Li, Yamei |
作者单位 | 1.Chengdu Univ Technol, Key Lab Earth Explorat & Informat Technol, Minist Educ, Chengdu 610059, Peoples R China 2.Minist Water Resources, Res Ctr Flood & Drought Disaster Reduct, Beijing 100038, Peoples R China 3.China Inst Water Resources & Hydropower Res, Beijing 100038, Peoples R China 4.Tsinghua Univ, State Key Lab Hydrosci & Engn, Beijing 100084, Peoples R China 5.Chinese Acad Sci, Inst Tibetan Plateau Res, State Key Lab Tibetan Plateau Earth Syst Environm, Beijing 100101, Peoples R China 6.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 7.Chinese Acad Sci, Inst Mt Hazards & Environm, Key Lab Mt Hazards & Earth Surface Proc, Chengdu 610041, Peoples R China |
推荐引用方式 GB/T 7714 | Wei, Ruilong,Li, Yamei,Li, Yao,et al. A universal adapter in segmentation models for transferable landslide mapping[J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING,2024,218:446-465. |
APA | Wei, Ruilong.,Li, Yamei.,Li, Yao.,Zhang, Bo.,Wang, Jiao.,...&Ye, Chengming.(2024).A universal adapter in segmentation models for transferable landslide mapping.ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING,218,446-465. |
MLA | Wei, Ruilong,et al."A universal adapter in segmentation models for transferable landslide mapping".ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING 218(2024):446-465. |
入库方式: OAI收割
来源:成都山地灾害与环境研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。