Free-Energy Principle Inspired Video Quality Metric and Its Use in Video Coding
文献类型：期刊论文
| 作者 | Xu, Long1,2 ; Lin, Weisi3; Ma, Lin4; Zhang, Yongbing5; Fang, Yuming6; Ngan, King Ngi7; Li, Songnan7; Yan, Yihua1
|
| 刊名 | IEEE TRANSACTIONS ON MULTIMEDIA
 |
| 出版日期 | 2016-04-01 |
| 卷号 | 18期号:4页码:590-602 |
| 关键词 | Free-energy principle perceptual video coding optimization video coding visual quality assessment (VQA) |
| 英文摘要 | In this paper, we extend the free-energy principle to video quality assessment (VQA) by incorporating with the recent psychophysical study on human visual speed perception (HVSP). A novel video quality metric, namely the free-energy principle inspired video quality metric (FePVQ), is therefore developed and applied to perceptual video coding optimization. The free-energy principle suggests that the human visual system (HVS) can actively predict "orderly" information and avoid "disorderly" information for image perception. Basically, "orderly" is associated with the skeletons and edges of objects, and "disorderly" mostly concerns textures in images. Based on this principle, an image is separated into orderly and disorderly regions, and processed differently in image quality assessment. For videos, visual attention, or fixation, is associated with the objects with significant motion according to HVSP, resulting in a motion strength factor in the FePVQ so that the free-energy principle is extended into spatio-temporal domain for VQA. In addition, we investigate the application of the FePVQ in perceptual rate distortion optimization (RDO). For this purpose, the FePVQ is realized with low computational cost by using the relative total variation model and the block-wise motion vectors of video coding to simulate the free-energy principle and the HVSP, respectively. The experimental results indicate that the proposed FePVQ is highly consistent with the HVS perception. The linear correlation coefficient and Spearman's rank-order correlation coefficient are up to 0.8324 and 0.8281 on the LIVE video database. Better perceptual quality of encoded video sequences is achieved by FePVQ-motivated RDO in video coding. |
| 收录类别 | SCI |
| 语种 | 英语 |
| WOS记录号 | WOS:000372790300004 |
| 源URL | [http://ir.bao.ac.cn/handle/114a11/5351]  |
| 专题 | 国家天文台_太阳物理研究部 |
| 作者单位 | 1.Chinese Acad Sci, Key Lab Solar Act, Natl Astron Observ, Beijing 100012, Peoples R China 2.Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Jiangsu Engn Ctr Network Monitoring, Nanjing 210044, Jiangsu, Peoples R China 3.Nanyang Technol Univ, Dept Comp Engn, Singapore 639798, Singapore 4.Huawei Noahs Ark Lab, Hong Kong 999077, Hong Kong, Peoples R China 5.Tsinghua Univ, Grad Sch Shenzhen, Shenzhen 518005, Peoples R China 6.Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Peoples R China 7.Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong 999077, Hong Kong, Peoples R China |
| 推荐引用方式 GB/T 7714 | Xu, Long,Lin, Weisi,Ma, Lin,et al. Free-Energy Principle Inspired Video Quality Metric and Its Use in Video Coding[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2016,18(4):590-602. |
| APA | Xu, Long.,Lin, Weisi.,Ma, Lin.,Zhang, Yongbing.,Fang, Yuming.,...&Yan, Yihua.(2016).Free-Energy Principle Inspired Video Quality Metric and Its Use in Video Coding.IEEE TRANSACTIONS ON MULTIMEDIA,18(4),590-602. |
| MLA | Xu, Long,et al."Free-Energy Principle Inspired Video Quality Metric and Its Use in Video Coding".IEEE TRANSACTIONS ON MULTIMEDIA 18.4(2016):590-602. |
入库方式： OAI收割
来源：国家天文台
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。