中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 地理科学与资源研究所
  3. 中国科学院地理科学与资源研究所
  4. 资源与环境信息系统国家重点实验室
  5. 外文论文
DDPM-SegFormer: Highly refined feature land use and land cover segmentation with a fused denoising diffusion probabilistic model and transformer

文献类型：期刊论文

作者Fan, Junfu2,3; Shi, Zongwen2; Ren, Zhoupeng3; Zhou, Yuke3; Ji, Min1
刊名INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION
出版日期2024-09-01
卷号133页码:104093
关键词Land use and land cover Semantic segmentation Remote sensing images Denoising diffusion probabilistic model Feature fusion Information bottlenecks
DOI10.1016/j.jag.2024.104093
产权排序2
文献子类Article
英文摘要The semantic segmentation of land use and land cover (LULC) is a crucial and widely employed remote sensing task. Conventional convolutional neural networks and vision transformers have been extensively utilized for LULC segmentation. However, high-resolution remote sensing images contain a wealth of spatial and color texture information, which is not fully exploited by traditional deep learning approaches. The information bottleneck of CNNs and transformers results in the loss of a significant amount of texture detail information during the feature extraction process, which further limits the performance of LULC segmentation. We present DDPM-SegFormer, a new framework that merges a denoising diffusion probabilistic model (DDPM) and vision transformer for LULC segmentation. The aim is to address the difficulties arising from extraction in complex geographic landscapes and to alleviate information bottlenecks. The framework utilizes the ability of a DDPM to generate refined semantic features and that of vision transformer to model the global image context. Our framework introduces two main innovations. First, we use a DDPM for the first time in LULC segmentation to generate highly refined multiscale semantic features. This approach alleviates the information bottleneck caused by relying solely on a CNN or transformer architecture. Second, we develop an effective feature-level fusion strategy that utilizes multihead cross-attention between the DDPM and Transformer. This approach achieves the harmonious fusion of fine-scale semantic features, generating continuous and highly refined semantic features that enhance the segmentation accuracy. The results indicate that DDPM-SegFormer achieves an MIOU of 83.72% and an F1-score of 90.97% for the large-scale LoveDA dataset and an MIOU of 90.91% and an F1score of 93.30% for the Tarim Basin LULC dataset in a desert scenario. The research demonstrated that the refined and continuous semantic features produced by DDPM-SegFormer can significantly enhance LULC segmentation performance.
WOS关键词REMOTE-SENSING IMAGES ; SEMANTIC SEGMENTATION ; CONVOLUTIONAL NETWORK ; CLASSIFICATION ; DENSENET
WOS研究方向Remote Sensing
WOS记录号WOS:001296937200001
出版者ELSEVIER
源URL[http://ir.igsnrr.ac.cn/handle/311030/206888]  
专题资源与环境信息系统国家重点实验室_外文论文
通讯作者Fan, Junfu
作者单位1.Shandong Univ Sci & Technol, Coll Geodesy & Geomatics, Qingdao 266510, Peoples R China
2.Shandong Univ Technol, Sch Civil Engn & Geomatics, Zibo 255000, Peoples R China
3.Chinese Acad Sci, Inst Geog Sci & Nat Resources Res, State Key Lab Resources & Environm Informat Syst, Beijing 100101, Peoples R China
推荐引用方式
GB/T 7714		 Fan, Junfu,Shi, Zongwen,Ren, Zhoupeng,et al. DDPM-SegFormer: Highly refined feature land use and land cover segmentation with a fused denoising diffusion probabilistic model and transformer[J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION,2024,133:104093.
APA Fan, Junfu,Shi, Zongwen,Ren, Zhoupeng,Zhou, Yuke,&Ji, Min.(2024).DDPM-SegFormer: Highly refined feature land use and land cover segmentation with a fused denoising diffusion probabilistic model and transformer.INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION,133,104093.
MLA Fan, Junfu,et al."DDPM-SegFormer: Highly refined feature land use and land cover segmentation with a fused denoising diffusion probabilistic model and transformer".INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION 133(2024):104093.

入库方式： OAI收割

来源：地理科学与资源研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。