中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Local and correlation attention learning for subtle facial expression recognition

文献类型:期刊论文

作者Wang, Shaocong2,3; Yuan, Yuan1; Zheng, Xiangtao3; Lu, Xiaoqiang3
刊名Neurocomputing
出版日期2020
关键词Facial expression recognition Feature extraction Neural network Attention mechanism
ISSN号09252312;18728286
DOI10.1016/j.neucom.2020.07.120
产权排序1
英文摘要

Subtle facial expression recognition (SFER) aims to classify facial expressions with very low intensity into corresponding human emotions. Subtle facial expression can be regarded as a special kind of facial expression, whose facial muscle movements are more difficult to capture. In the last decade, various methods have been developed for common facial expression recognition (FER). However, most of them failed to automatically find the most discriminative parts of facial expression and the correlation of muscle movements when human makes facial expression, which makes them unsuitable for SFER. To better solve SFER problem, an attention mechanism based model focusing on salient local regions and their correlations is proposed in this paper. The proposed method: 1) utilizes multiple attention blocks to attend to distinct discriminative regions and extract corresponding local features automatically, 2) a correlation attention module is integrated in the model to extract global correlation feature over the salient regions, and finally 3) fuses the correlation feature and local features in an efficient way for the final facial expression classification. By this way, the useful but subtle local information can be utilized in more detail, and the correlation of different local regions is also extracted. Extensive experiment on the LSEMSW and CK+ datasets shows that the method proposed in this paper achieves superior results, which demonstrates its effectiveness. © 2020 Elsevier B.V.

语种英语
出版者Elsevier B.V., Netherlands
源URL[http://ir.opt.ac.cn/handle/181661/93716]  
专题西安光学精密机械研究所_光学影像学习与分析中心
通讯作者Zheng, Xiangtao
作者单位1.Center for OPTical IMagery Analysis and Learning(OPTIMAL), Northwestern Polytechnical University, Xi'an; 710072, China
2.University of Chinese Academy of Sciences, Beijing; 100049, China;
3.Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an; Shaanxi; 710119, China;
推荐引用方式
GB/T 7714
Wang, Shaocong,Yuan, Yuan,Zheng, Xiangtao,et al. Local and correlation attention learning for subtle facial expression recognition[J]. Neurocomputing,2020.
APA Wang, Shaocong,Yuan, Yuan,Zheng, Xiangtao,&Lu, Xiaoqiang.(2020).Local and correlation attention learning for subtle facial expression recognition.Neurocomputing.
MLA Wang, Shaocong,et al."Local and correlation attention learning for subtle facial expression recognition".Neurocomputing (2020).

入库方式: OAI收割

来源:西安光学精密机械研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。