中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Image Denoising of Seam Images With Deep Learning for Laser Vision Seam Tracking

文献类型:期刊论文

作者Yang, Lei2,3; Fan, Junfeng1; Huo, Benyan2,3; Li, En1; Liu, Yanhong2,3
刊名IEEE SENSORS JOURNAL
出版日期2022-03-15
卷号22期号:6页码:6098-6107
ISSN号1530-437X
关键词Welding Laser noise Sensors Robots Laser modes Feature extraction Lasers Deep network architecture image denoising seam tracking robot welding structured light vision
DOI10.1109/JSEN.2022.3147489
通讯作者Liu, Yanhong(liuyh@zzu.edu.cn)
英文摘要Seam tracking with structured light vision has been widely applied into the robot welding. And the precise laser stripe extraction is the premise of automatic laser vision seam tracking. However, conventional laser stripe extraction methods based on image processing have the shortcomings of poor flexibility and robustness, which are easily affected by considerable image noises in the welding processing, such as arc light, smoke, and splash. To address this issue, inspired by image segmentation, with the strong contextual feature expression ability of deep convolutional neural network (DCNN), a novel image denoising method of seam images is proposed in this paper for automatic laser stripe extraction to serve intelligent robot welding applications, such as seam tracking, seam type detection, weld bead detection, etc. With the deep encoder-decoder network framework, aimed at the information loss issue by multiple convolutional and pooling operations in DCNNs, an attention dense convolutional block is proposed to extract and accumulate multi-scale feature maps. Meanwhile, a residual bi-directional ConvLSTM block (BiConvLSTM) is proposed to effectively learn multi-scale and long-range spatial contexts from local feature maps. Finally, a weighted loss function is proposed for model training to address the class unbalanced issue. Combined with the seam image set, the experimental results show that the proposed image denoising network could correctly extract the laser stripes from seam images which could demonstrate that the proposed method shows a high detection precision and good robustness against the strong image noise interference from welding process.
WOS关键词EXTRACTION ; SYSTEM ; IDENTIFICATION ; JOINT
资助项目National Natural Science Foundation of China[62003309] ; National Key Research and Development Project of China[2020YFB1313701] ; Science and Technology Research Project, Henan Province, China[202102210098] ; Outstanding Foreign Scientist Support Project in Henan Province of China[GZS2019008]
WOS研究方向Engineering ; Instruments & Instrumentation ; Physics
语种英语
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号WOS:000770054800134
资助机构National Natural Science Foundation of China ; National Key Research and Development Project of China ; Science and Technology Research Project, Henan Province, China ; Outstanding Foreign Scientist Support Project in Henan Province of China
源URL[http://ir.ia.ac.cn/handle/173211/48157]  
专题自动化研究所_复杂系统管理与控制国家重点实验室_先进机器人控制团队
复杂系统管理与控制国家重点实验室_水下机器人
通讯作者Liu, Yanhong
作者单位1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
2.Robot Percept & Control Engn Lab, Zhengzhou 450001, Henan, Peoples R China
3.Zhengzhou Univ, Sch Elect Engn, Zhengzhou 450001, Henan, Peoples R China
推荐引用方式
GB/T 7714
Yang, Lei,Fan, Junfeng,Huo, Benyan,et al. Image Denoising of Seam Images With Deep Learning for Laser Vision Seam Tracking[J]. IEEE SENSORS JOURNAL,2022,22(6):6098-6107.
APA Yang, Lei,Fan, Junfeng,Huo, Benyan,Li, En,&Liu, Yanhong.(2022).Image Denoising of Seam Images With Deep Learning for Laser Vision Seam Tracking.IEEE SENSORS JOURNAL,22(6),6098-6107.
MLA Yang, Lei,et al."Image Denoising of Seam Images With Deep Learning for Laser Vision Seam Tracking".IEEE SENSORS JOURNAL 22.6(2022):6098-6107.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。