中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Fusion Networks of CNN and Transformer with Channel Attention for Accurate Tumor Imaging in Magnetic Particle Imaging

文献类型:期刊论文

作者Shang, Yaxin3; Liu, Jie3; Wang, Yueqi1,2; Bertrand, Helene
刊名BIOLOGY-BASEL
出版日期2024
卷号13期号:1页码:17
关键词magnetic particle imaging convolutional neural network transformer tumor imaging accurate quantification
DOI10.3390/biology13010002
通讯作者Liu, Jie(jieliu@bjtu.edu.cn) ; Wang, Yueqi(yueqi.wang@ia.ac.cn)
英文摘要Simple Summary Accurate tumor localization is essential for effective clinical diagnosis and treatment. However, traditional magnetic particle imaging (MPI) algorithms struggle to precisely locate tumors, resulting in challenges when quantifying them. This study aims to address the issue of precise tumor localization in MPI through the application of a deep learning approach. By integrating Convolutional Neural Network (CNN) and Transformer modules, the goal is to improve image quality and enhance the accuracy of tumor quantification in MPI images. The research utilizes a combination of CNN and Transformer modules to capture both global and local features within MPI images. Through the application of deep learning techniques, the study seeks to remove blurry artifacts from reconstructed images, ultimately may help improve the precision of tumor localization and quantification in MPI. This approach holds significant potential for advancing MPI technology and introducing novel methodologies for future medical imaging research. Additionally, the validation of transfer learning on authentic MPI images may enhance the overall accuracy and reliability of MPI image reconstruction.Abstract Background: Magnetic Particle Imaging (MPI) is an emerging molecular imaging technique. However, since X-space reconstruction ignores system properties, it can lead to blurring of the reconstructed image, posing challenges for accurate quantification. To address this issue, we propose the use of deep learning to remove the blurry artifacts; (2) Methods: Our network architecture consists of a combination of Convolutional Neural Network (CNN) and Transformer. The CNN utilizes convolutional layers to automatically extract pixel-level local features and reduces the size of feature maps through pooling layers, effectively capturing local information within the images. The Transformer module is responsible for extracting contextual features from the images and efficiently capturing long-range dependencies, enabling a more effective modeling of global features in the images. By combining the features extracted by both CNN and Transformer, we capture both global and local features simultaneously, thereby improving the quality of reconstructed images; (3) Results: Experimental results demonstrate that the network effectively removes blurry artifacts from the images, and it exhibits high accuracy in precise tumor quantification. The proposed method shows superior performance over the state-of-the-art methods; (4) Conclusions: This bears significant implications for the image quality improvement and clinical application of MPI technology.
WOS关键词ARTIFACTS ; RESOLUTION ; REMOVAL ; MODEL
资助项目National Natural Science Foundation of China
WOS研究方向Life Sciences & Biomedicine - Other Topics
语种英语
出版者MDPI
WOS记录号WOS:001149256200001
资助机构National Natural Science Foundation of China
源URL[http://ir.ia.ac.cn/handle/173211/55406]  
专题自动化研究所_中国科学院分子影像重点实验室
通讯作者Liu, Jie; Wang, Yueqi
作者单位1.Univ Chinese Acad Sci, Beijing 100080, Peoples R China
2.Inst Automat, CAS Key Lab Mol Imaging, Beijing Key Lab Mol Imaging, Beijing 100190, Peoples R China
3.Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
推荐引用方式
GB/T 7714
Shang, Yaxin,Liu, Jie,Wang, Yueqi,et al. Fusion Networks of CNN and Transformer with Channel Attention for Accurate Tumor Imaging in Magnetic Particle Imaging[J]. BIOLOGY-BASEL,2024,13(1):17.
APA Shang, Yaxin,Liu, Jie,Wang, Yueqi,&Bertrand, Helene.(2024).Fusion Networks of CNN and Transformer with Channel Attention for Accurate Tumor Imaging in Magnetic Particle Imaging.BIOLOGY-BASEL,13(1),17.
MLA Shang, Yaxin,et al."Fusion Networks of CNN and Transformer with Channel Attention for Accurate Tumor Imaging in Magnetic Particle Imaging".BIOLOGY-BASEL 13.1(2024):17.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。