Dual-stream Representation Fusion Learning for accurate medical image segmentation
文献类型:期刊论文
作者 | Xu RT(许镕涛)1,3![]() ![]() ![]() ![]() |
刊名 | Engineering Applications of Artificial Intelligence
![]() |
出版日期 | 2023 |
卷号 | 123页码:106402 |
英文摘要 | Accurate segmenting regions of interest in various medical images are essential to clinical research and applications. Although deep learning-based methods have achieved good results, the fully automated segmentation results still need to be refined on the tininess, complexities, and irregularities of lesion shapes. To address this issue, we propose a Dual-stream Representation Fusion Learning (DRFL) paradigm for accurate clinical segmentation, including Dual-stream Fusion Module, Representation Fusion Transformer Module and Peakiness Fusion Attention Module. Specifically, Dual-stream Fusion Module can simultaneously generate binary masks and high-resolution images with segmentation stream and super-resolution stream that share a feature extractor, then both prediction outputs are merged as the input of Fusion Module to further improve the performance of the network for generating the final segmentation result; Representation Fusion Transformer Module is lightweight to fuse high-resolution representation and fine-grained structure representation; Peakiness Fusion Attention Module can capture more salient features while fusing more spatial information to improve the performance of the network. The effectiveness of our dual-stream representation fusion learning is validated on different medical image segmentation tasks, and extensive experiments show that our DRFL outperforms the state-of-the-art methods in segmentation quality of lung nodule segmentation, lung segmentation, cell contour segmentation, and prostate segmentation. Our code is available at https://github.com/Rongtao-Xu/RepresentationLearning/tree/main/DRFL-EAAI2023. |
源URL | [http://ir.ia.ac.cn/handle/173211/51657] ![]() |
专题 | 模式识别国家重点实验室_三维可视计算 多模态人工智能系统全国重点实验室 |
通讯作者 | Xu RT(许镕涛); Zhang XP(张晓鹏) |
作者单位 | 1.State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, China 2.School of Artificial Intelligence, Beijing University of Posts and Telecommunications, China 3.School of Artificial Intelligence, University of Chinese Academy of Sciences, China |
推荐引用方式 GB/T 7714 | Xu RT,Wang CW,Xu SB,et al. Dual-stream Representation Fusion Learning for accurate medical image segmentation[J]. Engineering Applications of Artificial Intelligence,2023,123:106402. |
APA | Xu RT,Wang CW,Xu SB,Meng WL,&Zhang XP.(2023).Dual-stream Representation Fusion Learning for accurate medical image segmentation.Engineering Applications of Artificial Intelligence,123,106402. |
MLA | Xu RT,et al."Dual-stream Representation Fusion Learning for accurate medical image segmentation".Engineering Applications of Artificial Intelligence 123(2023):106402. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。