中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
IVP: An Intelligent Video Processing Architecture for Video Streaming

文献类型：期刊论文

作者Gao, Chengsi2,3; Wang, Ying1; Han, Yinhe1; Chen, Weiwei2,3; Zhang, Lei3
刊名IEEE TRANSACTIONS ON COMPUTERS
出版日期2023
卷号72期号:1页码:264-277
关键词Video enhancement compressed video DNN approximate computing optical flow accelerator
ISSN号0018-9340
DOI10.1109/TC.2022.3155950
英文摘要Recently, video processing tasks, such as video enhancement and analysis, have received increasing attention from both academics and industries. However, the current video processing procedure on edge decouples the decoding phase and the subsequent video processing tasks, missing the opportunity to accelerate the procedure by orchestrating video decoding and enhancement stages. Thus, we propose an intelligent video processing workflow and architecture(IVP) for cloud-edge video streaming. For edge devices that receive compressed videos, IVP can perform direct DNN-based video enhancement, e.g., super-resolution and frame-interpolation. By leveraging the metadata motion vectors and residuals extracted from the encoded video, our architecture will significantly eliminate unnecessary frame pixels being processed by the DNNs and improve execution efficiency. The proposed IVP and workflow are proved to reduce up to 90% of the processing latency while producing accurate and high-quality videos. Furthermore, we observe a significant portion of similar optical flow in time domain of continuous videos, which can be used to reduce the computation overhead. Thus, to utilize such temporal similarity of optical flow, the proposed IVP is upgraded to be capable of reusing previous computation results, which further improves energy efficiency of the whole system.
资助项目National Natural Science Foundation of China[62090024] ; National Natural Science Foundation of China[61874124] ; Strategic Priority Research Program of Chinese Academy of Sciences[XDC05030201] ; Zhejiang Lab[2021PC0AC01]
WOS研究方向Computer Science ; Engineering
语种英语
WOS记录号WOS:000899952600021
出版者IEEE COMPUTER SOC
源URL[http://119.78.100.204/handle/2XEOYT63/20154]  
专题中国科学院计算技术研究所期刊论文
通讯作者Wang, Ying
作者单位1.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China
2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
3.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714		 Gao, Chengsi,Wang, Ying,Han, Yinhe,et al. IVP: An Intelligent Video Processing Architecture for Video Streaming[J]. IEEE TRANSACTIONS ON COMPUTERS,2023,72(1):264-277.
APA Gao, Chengsi,Wang, Ying,Han, Yinhe,Chen, Weiwei,&Zhang, Lei.(2023).IVP: An Intelligent Video Processing Architecture for Video Streaming.IEEE TRANSACTIONS ON COMPUTERS,72(1),264-277.
MLA Gao, Chengsi,et al."IVP: An Intelligent Video Processing Architecture for Video Streaming".IEEE TRANSACTIONS ON COMPUTERS 72.1(2023):264-277.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。