End-to-end learning interpolation for object tracking in low frame-rate video
文献类型:期刊论文
作者 | Liu, Liqiang1,2; Cao, Jianzhong1![]() |
刊名 | IET Image Processing
![]() |
出版日期 | 2020-05-11 |
卷号 | 14期号:6页码:1066-1072 |
关键词 | video signal processing learning (artificial intelligence) object tracking interpolation mobile computing low frame rates implicit video frame interpolation sub-network object tracking low frame-rate video high frame-rate latent video effective end-to-end optimisation frame rate tracking accuracy semantic video analytics end-to-end learning interpolation subsequent semantic analytics bandwidth constraints analytics performance |
ISSN号 | 17519659 |
DOI | 10.1049/iet-ipr.2019.0944 |
产权排序 | 1 |
英文摘要 | In many scenarios, where videos are transmitted through bandwidth-limited channels for subsequent semantic analytics, the choice of frame rates has to balance between bandwidth constraints and analytics performance. Faced with this practical challenge, this study focuses on enhancing object tracking at low frame rates and proposes a learning Interpolation for tracking framework. This framework embeds an implicit video frame interpolation sub-network, which is concatenated and jointly trained with another object tracking sub-network. Once a low frame-rate video is an input, it is first mapped into a high frame-rate latent video, based on which the tracker is learned. Novel strategies and loss functions are derived to ensure the effective end-to-end optimisation of the authors' network. On several challenging benchmarks and settings, their method achieves a highly competitive tradeoff between frame rate and tracking accuracy. As is known, the implications of interpolation on semantic video analytics and tracking remain unexplored, and the authors expect their method to find many applications in mobile embedded vision, Internet of Things and edge computing. © The Institution of Engineering and Technology 2020 |
语种 | 英语 |
WOS记录号 | WOS:000530456000008 |
出版者 | Institution of Engineering and Technology |
源URL | [http://ir.opt.ac.cn/handle/181661/93422] ![]() |
专题 | 西安光学精密机械研究所_动态光学成像研究室 |
作者单位 | 1.Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, No. 17, Xinxi Road, Xi'an, China; 2.University of Chinese Academy of Sciences, No.19, Yuquan Road, Beijing, China |
推荐引用方式 GB/T 7714 | Liu, Liqiang,Cao, Jianzhong. End-to-end learning interpolation for object tracking in low frame-rate video[J]. IET Image Processing,2020,14(6):1066-1072. |
APA | Liu, Liqiang,&Cao, Jianzhong.(2020).End-to-end learning interpolation for object tracking in low frame-rate video.IET Image Processing,14(6),1066-1072. |
MLA | Liu, Liqiang,et al."End-to-end learning interpolation for object tracking in low frame-rate video".IET Image Processing 14.6(2020):1066-1072. |
入库方式: OAI收割
来源:西安光学精密机械研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。