中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
AFCANet: An adaptive feature concatenate attention network for multi-focus image fusion

文献类型:期刊论文

作者Liu, Shuaiqi1,2,4; Peng, Weijian1,4; Liu, Yali1,4; Zhao, Jie1,4; Su, Yonggang1,4; Zhang, Yudong3
刊名JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES
出版日期2023-10-01
卷号35期号:9页码:22
ISSN号1319-1578
关键词Multi -focus image fusion Unsupervised training Adaptive feature concatenate Attention module
DOI10.1016/j.jksuci.2023.101751
通讯作者Su, Yonggang(ygsu0726@163.com) ; Zhang, Yudong()
英文摘要For multi-focus image fusion, the existing deep learning based methods cannot effectively learn the texture features and semantic information of the source image to generate high-quality fused images. Thus, we develop a new adaptive feature concatenate attention network named AFCANet, which adaptively learns cross-layer features and retains the texture features and semantic information of images to generate visually appealing fully focused images. In AFCANet, the encoder-decoder network is used as the backbone network. In the unsupervised training stage, an adaptive cross-layer skip connection mode is designed, and a cross-layer adaptive coordinate attention module is built to acquire meaningful information from the image along with ignoring unimportant information to obtain a better image fusion effect. In addition, in the middle of the encoder-decoder network, we also introduce an effective channel attention module to fully learn the output of the encoder, and accelerate network convergence. In the inference stage, we apply the pixel-based spatial frequency fusion rules to fuse the adaptive features learned by the encoder, which can successfully combine the texture and semantic information of the image and produce a more precise decision map. Extensive experiments on public datasets and the HBU-CVMDSP dataset show that our AFCANet can effectively improve the accuracy of the decision map in the focus and defocus regions, as well as improve the ability to retain the abundant details and edge features of the source image.(c) 2023 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
WOS关键词ALGORITHM
资助项目Natural Science Foun- dation of Hebei Province[F2022201055] ; Natural Science Foun- dation of Hebei Province[2022M713361] ; National Natural Science Foundation of China[62172139] ; Natural Science Foundation of Hebei Province[F2022201055] ; China Postdoctoral[2022M713361] ; Hebei University Research and Innovation Team Support Project[IT2023B05] ; Natural Science Interdisciplinary Research Program of Hebei University[DXK202102] ; Open Project Program of the National Laboratory of Pattern Recognition (NLPR)[202200007] ; High-Performance Computing Center of Hebei University
WOS研究方向Computer Science
语种英语
出版者ELSEVIER
WOS记录号WOS:001082388200001
资助机构Natural Science Foun- dation of Hebei Province ; National Natural Science Foundation of China ; Natural Science Foundation of Hebei Province ; China Postdoctoral ; Hebei University Research and Innovation Team Support Project ; Natural Science Interdisciplinary Research Program of Hebei University ; Open Project Program of the National Laboratory of Pattern Recognition (NLPR) ; High-Performance Computing Center of Hebei University
源URL[http://ir.ia.ac.cn/handle/173211/52974]  
专题多模态人工智能系统全国重点实验室
通讯作者Su, Yonggang; Zhang, Yudong
作者单位1.Machine Vis Technol Innovat Ctr Hebei Prov, Baoding 071000, Peoples R China
2.Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
3.Univ Leicester, Sch Comp & Math Sci, Leicester LE1 7RH, England
4.Hebei Univ, Coll Elect & Informat Engn, Baoding 071000, Hebei, Peoples R China
推荐引用方式
GB/T 7714
Liu, Shuaiqi,Peng, Weijian,Liu, Yali,et al. AFCANet: An adaptive feature concatenate attention network for multi-focus image fusion[J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES,2023,35(9):22.
APA Liu, Shuaiqi,Peng, Weijian,Liu, Yali,Zhao, Jie,Su, Yonggang,&Zhang, Yudong.(2023).AFCANet: An adaptive feature concatenate attention network for multi-focus image fusion.JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES,35(9),22.
MLA Liu, Shuaiqi,et al."AFCANet: An adaptive feature concatenate attention network for multi-focus image fusion".JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES 35.9(2023):22.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。