中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Dual-stream Representation Fusion Learning for accurate medical image segmentation

文献类型:期刊论文

作者Xu RT(许镕涛)1,3; Wang CW(王常维)1,3; Xu SB(徐士彪)2; Meng WL(孟维亮)1; Zhang XP(张晓鹏)1
刊名Engineering Applications of Artificial Intelligence
出版日期2023
卷号123页码:106402
英文摘要

Accurate segmenting regions of interest in various medical images are essential to clinical research and applications. Although deep learning-based methods have achieved good results, the fully automated segmentation results still need to be refined on the tininess, complexities, and irregularities of lesion shapes. To address this issue, we propose a Dual-stream Representation Fusion Learning (DRFL) paradigm for accurate clinical segmentation, including Dual-stream Fusion Module, Representation Fusion Transformer Module and Peakiness Fusion Attention Module. Specifically, Dual-stream Fusion Module can simultaneously generate binary masks and high-resolution images with segmentation stream and super-resolution stream that share a feature extractor, then both prediction outputs are merged as the input of Fusion Module to further improve the performance of the network for generating the final segmentation result; Representation Fusion Transformer Module is lightweight to fuse high-resolution representation and fine-grained structure representation; Peakiness Fusion Attention Module can capture more salient features while fusing more spatial information to improve the performance of the network. The effectiveness of our dual-stream representation fusion learning is validated on different medical image segmentation tasks, and extensive experiments show that our DRFL outperforms the state-of-the-art methods in segmentation quality of lung nodule segmentation, lung segmentation, cell contour segmentation, and prostate segmentation. Our code is available at https://github.com/Rongtao-Xu/RepresentationLearning/tree/main/DRFL-EAAI2023.

源URL[http://ir.ia.ac.cn/handle/173211/51657]  
专题模式识别国家重点实验室_三维可视计算
多模态人工智能系统全国重点实验室
通讯作者Xu RT(许镕涛); Zhang XP(张晓鹏)
作者单位1.State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, China
2.School of Artificial Intelligence, Beijing University of Posts and Telecommunications, China
3.School of Artificial Intelligence, University of Chinese Academy of Sciences, China
推荐引用方式
GB/T 7714
Xu RT,Wang CW,Xu SB,et al. Dual-stream Representation Fusion Learning for accurate medical image segmentation[J]. Engineering Applications of Artificial Intelligence,2023,123:106402.
APA Xu RT,Wang CW,Xu SB,Meng WL,&Zhang XP.(2023).Dual-stream Representation Fusion Learning for accurate medical image segmentation.Engineering Applications of Artificial Intelligence,123,106402.
MLA Xu RT,et al."Dual-stream Representation Fusion Learning for accurate medical image segmentation".Engineering Applications of Artificial Intelligence 123(2023):106402.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。