中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Spatio-Temporal Learning for Video Deblurring based on Two-Stream Generative Adversarial Network

文献类型:期刊论文

作者Song, Liyao1; Wang, Quan2; Li, Haiwei2; Fan, Jiancun3; Hu, Bingliang2
刊名Neural Processing Letters
关键词Two-stream video-deblurring spatio-temporal generative adversarial network
ISSN号13704621;1573773X
DOI10.1007/s11063-021-10520-y
产权排序2
英文摘要

Video-deblurring has achieved excellent results by using deep learning approaches. How to capture the dynamic spatio-temporal information in the videos is crucial on deblurring. In this paper, we propose a two-stream DeblurGAN which combines a 3D stream with a 2D stream to deblur. The 3D convolution provides spatial and temporal invariance to restore the foreground of frames, while the 2D convolution is sufficient to deal with spatial features, given a relatively consistant background. Thus, our model takes advantage of the great processing power of the 3D stream to handle the foreground which usually contains more dynamical motion blur, and the advantage of the simplicity of the 2D stream to handle the mostly consistent background. We have the full advantage of combining both the 3D convolution and the 2D convolution. Then we take the two-stream model as the generator and adopt the adversarial learning. We test our model on the VideoDeblurring and GOPRO datasets, and compare with other methods which we have listed. Our method outperforms others in the Peak Signal-to-Noise Ratio (PSNR), especially shows a good performance handling the foreground with obvious motion blur. © 2021, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.

语种英语
WOS记录号WOS:000643175000003
出版者Springer
源URL[http://ir.opt.ac.cn/handle/181661/94733]  
专题西安光学精密机械研究所_光学影像学习与分析中心
通讯作者Song, Liyao
作者单位1.School of Information and Communications Engineering, Xi’an Jiaotong University, Xi’an, China;
2.Key Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics of Chinese Academy of Sciences, Xi’an, China;
3.The School of Information and Communications Engineering, Xi’an Jiaotong University, Xi’an, China
推荐引用方式
GB/T 7714
Song, Liyao,Wang, Quan,Li, Haiwei,et al. Spatio-Temporal Learning for Video Deblurring based on Two-Stream Generative Adversarial Network[J]. Neural Processing Letters.
APA Song, Liyao,Wang, Quan,Li, Haiwei,Fan, Jiancun,&Hu, Bingliang.
MLA Song, Liyao,et al."Spatio-Temporal Learning for Video Deblurring based on Two-Stream Generative Adversarial Network".Neural Processing Letters

入库方式: OAI收割

来源:西安光学精密机械研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。