Specular highlight removal for endoscopic images using partial attention network
文献类型：期刊论文
| 作者 | Zhang, Chong1,2 ; Liu, Yueliang1; Wang, Kun2; Tian, Jie2,3
|
| 刊名 | PHYSICS IN MEDICINE AND BIOLOGY
 |
| 出版日期 | 2023-11-21 |
| 卷号 | 68期号:22页码:17 |
| ISSN号 | 0031-9155 |
| 关键词 | Endoscopic imaging partial attention network deep learning highlight removal |
| DOI | 10.1088/1361-6560/ad02d9 |
| 通讯作者 | Wang, Kun(kun.wang@ia.ac.cn) ; Tian, Jie(jie.tian@ia.ac.cn) |
| 英文摘要 | Objective. Endoscopic imaging is a visualization method widely used in minimally invasive surgery. However, owing to the strong reflection of the mucus layer on the organs, specular highlights often appear to degrade the imaging performance. Thus, it is necessary to develop an effective highlight removal method for endoscopic imaging. Approach. A specular highlight removal method using a partial attention network (PatNet) for endoscopic imaging is proposed to reduce the interference of bright light in endoscopic surgery. The method is designed as two procedures: highlight segmentation and endoscopic image inpainting. Image segmentation uses brightness threshold based on illumination compensation to divide the endoscopic image into the highlighted mask and the non-highlighted area. The image inpainting algorithm uses a partial convolution network that integrates an attention mechanism. A mask dataset with random hopping points is designed to simulate specular highlight in endoscopic imaging for network training. Through the filtering of masks, the method can focus on recovering defective pixels and preserving valid pixels as much as possible. Main results. The PatNet is compared with 3 highlight segmentation methods, 3 imaging inpainting methods and 5 highlight removal methods for effective analysis. Experimental results show that the proposed method provides better performance in terms of both perception and quantification. In addition, surgeons are invited to score the processing results for different highlight removal methods under realistic reflection conditions. The PatNet received the highest score of 4.18. Correspondingly, the kendall's W is 0.757 and the asymptotic significance p = 0.000 < 0.01, revealing that the subjective scores have good consistency and confidence. Significance. Generally, the method can realize irregular shape highlight reflection removal and image restoration close to the ground truth of endoscopic images. This method can improve the quality of endoscopic imaging for accurate image analysis. |
| WOS关键词 | QUALITY ASSESSMENT ; CLASSIFICATION |
| 资助项目 | The authors would like to acknowledge the instrumental and technical support of the Multimodal Biomedical Imaging Experimental Platform, Institute of Automation, CAS and the clinical trials support from the Department of Thoracic Surgery, Hainan General Ho ; Multimodal Biomedical Imaging Experimental Platform, Institute of Automation, CAS ; Department of Thoracic Surgery, Hainan General Hospital |
| WOS研究方向 | Engineering ; Radiology, Nuclear Medicine & Medical Imaging |
| 语种 | 英语 |
| 出版者 | IOP Publishing Ltd |
| WOS记录号 | WOS:001103388200001 |
| 资助机构 | The authors would like to acknowledge the instrumental and technical support of the Multimodal Biomedical Imaging Experimental Platform, Institute of Automation, CAS and the clinical trials support from the Department of Thoracic Surgery, Hainan General Ho ; Multimodal Biomedical Imaging Experimental Platform, Institute of Automation, CAS ; Department of Thoracic Surgery, Hainan General Hospital |
| 源URL | [http://ir.ia.ac.cn/handle/173211/55168]  |
| 专题 | 自动化研究所_中国科学院分子影像重点实验室 |
| 通讯作者 | Wang, Kun; Tian, Jie |
| 作者单位 | 1.Beijing Technol & Business Univ, Sch Int Econ & Management, Dept Big Data Management & Applicat, Beijing, Peoples R China 2.Chinese Acad Sci, Inst Automat, CAS Key Lab Mol Imaging, Beijing, Peoples R China 3.Beihang Univ, Beijing Adv Innovat Ctr Big Data Based Precis Med, Beijing, Peoples R China |
| 推荐引用方式 GB/T 7714 | Zhang, Chong,Liu, Yueliang,Wang, Kun,et al. Specular highlight removal for endoscopic images using partial attention network[J]. PHYSICS IN MEDICINE AND BIOLOGY,2023,68(22):17. |
| APA | Zhang, Chong,Liu, Yueliang,Wang, Kun,&Tian, Jie.(2023).Specular highlight removal for endoscopic images using partial attention network.PHYSICS IN MEDICINE AND BIOLOGY,68(22),17. |
| MLA | Zhang, Chong,et al."Specular highlight removal for endoscopic images using partial attention network".PHYSICS IN MEDICINE AND BIOLOGY 68.22(2023):17. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。