Bio-Inspired Representation Learning for Visual Attention Prediction
文献类型:期刊论文
作者 | Yuan, Yuan3![]() ![]() |
刊名 | IEEE TRANSACTIONS ON CYBERNETICS
![]() |
出版日期 | 2021-07 |
卷号 | 51期号:7页码:3562-3575 |
关键词 | Bio-inspired center-bias prior contrast features densely connected reduction-attention semantic features visual attention prediction (VAP) |
ISSN号 | 2168-2267;2168-2275 |
DOI | 10.1109/TCYB.2019.2931735 |
产权排序 | 2 |
英文摘要 | Visual attention prediction (VAP) is a significant and imperative issue in the field of computer vision. Most of the existing VAP methods are based on deep learning. However, they do not fully take advantage of the low-level contrast features while generating the visual attention map. In this article, a novel VAP method is proposed to generate the visual attention map via bio-inspired representation learning. The bio-inspired representation learning combines both low-level contrast and high-level semantic features simultaneously, which are developed by the fact that the human eye is sensitive to the patches with high contrast and objects with high semantics. The proposed method is composed of three main steps: 1) feature extraction; 2) bio-inspired representation learning; and 3) visual attention map generation. First, the high-level semantic feature is extracted from the refined VGG16, while the low-level contrast feature is extracted by the proposed contrast feature extraction block in a deep network. Second, during bio-inspired representation learning, both the extracted low-level contrast and high-level semantic features are combined by the designed densely connected block, which is proposed to concatenate various features scale by scale. Finally, the weighted-fusion layer is exploited to generate the ultimate visual attention map based on the obtained representations after bio-inspired representation learning. Extensive experiments are performed to demonstrate the effectiveness of the proposed method. |
语种 | 英语 |
WOS记录号 | WOS:000665001500014 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
源URL | [http://ir.opt.ac.cn/handle/181661/94935] ![]() |
专题 | 西安光学精密机械研究所_光学影像学习与分析中心 |
通讯作者 | Lu, Xiaoqiang |
作者单位 | 1.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 2.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Key Lab Spectral Imaging Technol CAS, Xian 710119, Peoples R China 3.Northwestern Polytech Univ, Sch Comp Sci, Ctr Optic Imagery Anal & Learning, Xian 710072, Peoples R China |
推荐引用方式 GB/T 7714 | Yuan, Yuan,Ning, Hailong,Lu, Xiaoqiang. Bio-Inspired Representation Learning for Visual Attention Prediction[J]. IEEE TRANSACTIONS ON CYBERNETICS,2021,51(7):3562-3575. |
APA | Yuan, Yuan,Ning, Hailong,&Lu, Xiaoqiang.(2021).Bio-Inspired Representation Learning for Visual Attention Prediction.IEEE TRANSACTIONS ON CYBERNETICS,51(7),3562-3575. |
MLA | Yuan, Yuan,et al."Bio-Inspired Representation Learning for Visual Attention Prediction".IEEE TRANSACTIONS ON CYBERNETICS 51.7(2021):3562-3575. |
入库方式: OAI收割
来源:西安光学精密机械研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。