A Snapshot Multi-Spectral Demosaicing Method for Multi-Spectral Filter Array Images Based on Channel Attention Network
文献类型:期刊论文
作者 | Zhang, Xuejun2,3; Dai, Yidan2,3; Zhang, Geng3![]() ![]() |
刊名 | SENSORS
![]() |
出版日期 | 2024-02 |
卷号 | 24期号:3 |
关键词 | multi-spectral filter array demosaicing convolution neural network |
ISSN号 | 1424-8220 |
DOI | 10.3390/s24030943 |
产权排序 | 1 |
英文摘要 | Multi-spectral imaging technologies have made great progress in the past few decades. The development of snapshot cameras equipped with a specific multi-spectral filter array (MSFA) allow dynamic scenes to be captured on a miniaturized platform across multiple spectral bands, opening up extensive applications in quantitative and visualized analysis. However, a snapshot camera based on MSFA captures a single band per pixel; thus, the other spectral band components of pixels are all missed. The raw images, which are captured by snapshot multi-spectral imaging systems, require a reconstruction procedure called demosaicing to estimate a fully defined multi-spectral image (MSI). With increasing spectral bands, the challenge of demosaicing becomes more difficult. Furthermore, the existing demosaicing methods will produce adverse artifacts and aliasing because of the adverse effects of spatial interpolation and the inadequacy of the number of layers in the network structure. In this paper, a novel multi-spectral demosaicing method based on a deep convolution neural network (CNN) is proposed for the reconstruction of full-resolution multi-spectral images from raw MSFA-based spectral mosaic images. The CNN is integrated with the channel attention mechanism to protect important channel features. We verify the merits of the proposed method using 5 x 5 raw mosaic images on synthetic as well as real-world data. The experimental results show that the proposed method outperforms the existing demosaicing methods in terms of spatial details and spectral fidelity. |
语种 | 英语 |
WOS记录号 | WOS:001160273300001 |
出版者 | MDPI |
源URL | [http://ir.opt.ac.cn/handle/181661/97213] ![]() |
专题 | 西安光学精密机械研究所_光学影像学习与分析中心 |
通讯作者 | Zhang, Geng; Hu, Bingliang |
作者单位 | 1.Wuhan Univ, Inst Aerosp Sci & Technol, Sch Remote Sensing & Informat Engn, Wuhan, Hubei, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Peoples R China |
推荐引用方式 GB/T 7714 | Zhang, Xuejun,Dai, Yidan,Zhang, Geng,et al. A Snapshot Multi-Spectral Demosaicing Method for Multi-Spectral Filter Array Images Based on Channel Attention Network[J]. SENSORS,2024,24(3). |
APA | Zhang, Xuejun,Dai, Yidan,Zhang, Geng,Zhang, Xuemin,&Hu, Bingliang.(2024).A Snapshot Multi-Spectral Demosaicing Method for Multi-Spectral Filter Array Images Based on Channel Attention Network.SENSORS,24(3). |
MLA | Zhang, Xuejun,et al."A Snapshot Multi-Spectral Demosaicing Method for Multi-Spectral Filter Array Images Based on Channel Attention Network".SENSORS 24.3(2024). |
入库方式: OAI收割
来源:西安光学精密机械研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。