中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Bio-Inspired Representation Learning for Visual Attention Prediction

文献类型:期刊论文

作者Yuan, Yuan3; Ning, Hailong1,2; Lu, Xiaoqiang2
刊名IEEE TRANSACTIONS ON CYBERNETICS
出版日期2021-07
卷号51期号:7页码:3562-3575
关键词Bio-inspired center-bias prior contrast features densely connected reduction-attention semantic features visual attention prediction (VAP)
ISSN号2168-2267;2168-2275
DOI10.1109/TCYB.2019.2931735
产权排序2
英文摘要

Visual attention prediction (VAP) is a significant and imperative issue in the field of computer vision. Most of the existing VAP methods are based on deep learning. However, they do not fully take advantage of the low-level contrast features while generating the visual attention map. In this article, a novel VAP method is proposed to generate the visual attention map via bio-inspired representation learning. The bio-inspired representation learning combines both low-level contrast and high-level semantic features simultaneously, which are developed by the fact that the human eye is sensitive to the patches with high contrast and objects with high semantics. The proposed method is composed of three main steps: 1) feature extraction; 2) bio-inspired representation learning; and 3) visual attention map generation. First, the high-level semantic feature is extracted from the refined VGG16, while the low-level contrast feature is extracted by the proposed contrast feature extraction block in a deep network. Second, during bio-inspired representation learning, both the extracted low-level contrast and high-level semantic features are combined by the designed densely connected block, which is proposed to concatenate various features scale by scale. Finally, the weighted-fusion layer is exploited to generate the ultimate visual attention map based on the obtained representations after bio-inspired representation learning. Extensive experiments are performed to demonstrate the effectiveness of the proposed method.

语种英语
WOS记录号WOS:000665001500014
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
源URL[http://ir.opt.ac.cn/handle/181661/94935]  
专题西安光学精密机械研究所_光学影像学习与分析中心
通讯作者Lu, Xiaoqiang
作者单位1.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
2.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Key Lab Spectral Imaging Technol CAS, Xian 710119, Peoples R China
3.Northwestern Polytech Univ, Sch Comp Sci, Ctr Optic Imagery Anal & Learning, Xian 710072, Peoples R China
推荐引用方式
GB/T 7714
Yuan, Yuan,Ning, Hailong,Lu, Xiaoqiang. Bio-Inspired Representation Learning for Visual Attention Prediction[J]. IEEE TRANSACTIONS ON CYBERNETICS,2021,51(7):3562-3575.
APA Yuan, Yuan,Ning, Hailong,&Lu, Xiaoqiang.(2021).Bio-Inspired Representation Learning for Visual Attention Prediction.IEEE TRANSACTIONS ON CYBERNETICS,51(7),3562-3575.
MLA Yuan, Yuan,et al."Bio-Inspired Representation Learning for Visual Attention Prediction".IEEE TRANSACTIONS ON CYBERNETICS 51.7(2021):3562-3575.

入库方式: OAI收割

来源:西安光学精密机械研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。