Fusion Networks of CNN and Transformer with Channel Attention for Accurate Tumor Imaging in Magnetic Particle Imaging
文献类型:期刊论文
作者 | Shang, Yaxin3; Liu, Jie3; Wang, Yueqi1,2; Bertrand, Helene |
刊名 | BIOLOGY-BASEL |
出版日期 | 2024 |
卷号 | 13期号:1页码:17 |
关键词 | magnetic particle imaging convolutional neural network transformer tumor imaging accurate quantification |
DOI | 10.3390/biology13010002 |
通讯作者 | Liu, Jie(jieliu@bjtu.edu.cn) ; Wang, Yueqi(yueqi.wang@ia.ac.cn) |
英文摘要 | Simple Summary Accurate tumor localization is essential for effective clinical diagnosis and treatment. However, traditional magnetic particle imaging (MPI) algorithms struggle to precisely locate tumors, resulting in challenges when quantifying them. This study aims to address the issue of precise tumor localization in MPI through the application of a deep learning approach. By integrating Convolutional Neural Network (CNN) and Transformer modules, the goal is to improve image quality and enhance the accuracy of tumor quantification in MPI images. The research utilizes a combination of CNN and Transformer modules to capture both global and local features within MPI images. Through the application of deep learning techniques, the study seeks to remove blurry artifacts from reconstructed images, ultimately may help improve the precision of tumor localization and quantification in MPI. This approach holds significant potential for advancing MPI technology and introducing novel methodologies for future medical imaging research. Additionally, the validation of transfer learning on authentic MPI images may enhance the overall accuracy and reliability of MPI image reconstruction.Abstract Background: Magnetic Particle Imaging (MPI) is an emerging molecular imaging technique. However, since X-space reconstruction ignores system properties, it can lead to blurring of the reconstructed image, posing challenges for accurate quantification. To address this issue, we propose the use of deep learning to remove the blurry artifacts; (2) Methods: Our network architecture consists of a combination of Convolutional Neural Network (CNN) and Transformer. The CNN utilizes convolutional layers to automatically extract pixel-level local features and reduces the size of feature maps through pooling layers, effectively capturing local information within the images. The Transformer module is responsible for extracting contextual features from the images and efficiently capturing long-range dependencies, enabling a more effective modeling of global features in the images. By combining the features extracted by both CNN and Transformer, we capture both global and local features simultaneously, thereby improving the quality of reconstructed images; (3) Results: Experimental results demonstrate that the network effectively removes blurry artifacts from the images, and it exhibits high accuracy in precise tumor quantification. The proposed method shows superior performance over the state-of-the-art methods; (4) Conclusions: This bears significant implications for the image quality improvement and clinical application of MPI technology. |
WOS关键词 | ARTIFACTS ; RESOLUTION ; REMOVAL ; MODEL |
资助项目 | National Natural Science Foundation of China |
WOS研究方向 | Life Sciences & Biomedicine - Other Topics |
语种 | 英语 |
出版者 | MDPI |
WOS记录号 | WOS:001149256200001 |
资助机构 | National Natural Science Foundation of China |
源URL | [http://ir.ia.ac.cn/handle/173211/55406] |
专题 | 自动化研究所_中国科学院分子影像重点实验室 |
通讯作者 | Liu, Jie; Wang, Yueqi |
作者单位 | 1.Univ Chinese Acad Sci, Beijing 100080, Peoples R China 2.Inst Automat, CAS Key Lab Mol Imaging, Beijing Key Lab Mol Imaging, Beijing 100190, Peoples R China 3.Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China |
推荐引用方式 GB/T 7714 | Shang, Yaxin,Liu, Jie,Wang, Yueqi,et al. Fusion Networks of CNN and Transformer with Channel Attention for Accurate Tumor Imaging in Magnetic Particle Imaging[J]. BIOLOGY-BASEL,2024,13(1):17. |
APA | Shang, Yaxin,Liu, Jie,Wang, Yueqi,&Bertrand, Helene.(2024).Fusion Networks of CNN and Transformer with Channel Attention for Accurate Tumor Imaging in Magnetic Particle Imaging.BIOLOGY-BASEL,13(1),17. |
MLA | Shang, Yaxin,et al."Fusion Networks of CNN and Transformer with Channel Attention for Accurate Tumor Imaging in Magnetic Particle Imaging".BIOLOGY-BASEL 13.1(2024):17. |
入库方式: OAI收割
来源:自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。