Face Attribute Recognition with Multimodal Fusion
文献类型：会议论文
| 作者 | Zhao M(赵明)1,2,3 ; Liu C(刘畅)1,2,3; Zheng ZY(郑泽宇)1,2,3; Yao QF(么庆丰)1,2,3; Yang N(杨楠)1,2,3; Xu YY(许原野)1,2,3
|
| 出版日期 | 2020 |
| 会议日期 | November 20-22, 2020 |
| 会议地点 | Shenyang, China |
| 关键词 | Face attribute recognition Multimodal fusion Graph neural network Multi-task learning |
| 页码 | 478-483 |
| 英文摘要 | Facial attribute recognition is a challenging question, especially the potential high-level semantic features between attributes are a research focus of attribute recognition research. In this paper, a face attribute recognition network is proposed based on multimodal fusion, which is completely data-driven and incorporates image features and advanced semantic features of attributes: 1) We design an image feature extraction network with an underlying shared network that does not restrict the specific form. Meanwhile, a layer-parameter orthogonalization operation is unveiled, which can increase the expressive power of the features. 2) Using graph convolutional networks (GCN), we build a semantic feature extraction network to extract advanced semantic features of face attributes and mine correlations between attributes. 3) To enhance the representation of features, we propose a multimodal fusion module to fuse two complementary representations of image features and semantic features. 4) We construct fused feature classification networks using attribute-independent high-level networks to predict multiple attributes separately. We have conducted extensive experiments to demonstrate the effectiveness of the proposed method and have obtained results that are competitive with state-of-the-art methods. |
| 产权排序 | 1 |
| 会议录 | 2020 IEEE 3rd International Conference on Automation, Electronics and Electrical Engineering, AUTEEE 2020
 |
| 会议录出版者 | IEEE |
| 会议录出版地 | New York |
| 语种 | 英语 |
| ISBN号 | 978-1-7281-9827-9 |
| 源URL | [http://ir.sia.cn/handle/173321/28318]  |
| 专题 | 沈阳自动化研究所_数字工厂研究室 |
| 通讯作者 | Zhao M(赵明) |
| 作者单位 | 1.Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China 2.Institutes for Robotics and Intelligent Manufacturing, Shenyang 110016, China 3.University of Chinese Academy of Sciences, Beijing 100049, China |
| 推荐引用方式 GB/T 7714 | Zhao M,Liu C,Zheng ZY,et al. Face Attribute Recognition with Multimodal Fusion[C]. 见:. Shenyang, China. November 20-22, 2020. |
入库方式： OAI收割
来源：沈阳自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。