Meta-MMFNet: Meta-learning-based Multi-model Fusion Network for Micro-expression Recognition
文献类型：期刊论文
| 作者 | Gong, Wenjuan4; Zhang, Yue4; Wang, Wei3; Cheng, Peng2; Gonzalez, Jordi1 |
| 刊名 | ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS
 |
| 出版日期 | 2024-02-01 |
| 卷号 | 20期号:2页码:20 |
| 关键词 | Feature fusion model fusion meta-learning micro-expression recognition |
| ISSN号 | 1551-6857 |
| DOI | 10.1145/3539576 |
| 通讯作者 | Gong, Wenjuan(wenjuangong@upc.edu.cn) |
| 英文摘要 | Despite its wide applications in criminal investigations and clinical communications with patients suffering from autism, automatic micro-expression recognition remains a challenging problem because of the lack of training data and imbalanced classes problems. In this study, we proposed a meta-learning-based multi-model fusion network (Meta-MMFNet) to solve the existing problems. The proposed method is based on the metric-based meta-learning pipeline, which is specifically designed for few-shot learning and is suitable for model-level fusion. The frame difference and optical flow features were fused, deep features were extracted from the fused feature, and finally in themeta-learning-based framework, weighted summodel fusion method was applied for micro-expression classification. Meta-MMFNet achieved better results than state-of-the-art methods on four datasets. The code is available at https://github.com/wenjgong/meta-fusion- based- method. |
| 资助项目 | Spanish Ministry of Economy and Competitiveness (MINECO) ; European Regional Development Fund (ERDF)[PID2020-120311RB-I00/AEI/10.13039/501100011033] |
| WOS研究方向 | Computer Science |
| 语种 | 英语 |
| WOS记录号 | WOS:001092595800009 |
| 出版者 | ASSOC COMPUTING MACHINERY |
| 资助机构 | Spanish Ministry of Economy and Competitiveness (MINECO) ; European Regional Development Fund (ERDF) |
| 源URL | [http://ir.ia.ac.cn/handle/173211/54445]  |
| 专题 | 多模态人工智能系统全国重点实验室 |
| 通讯作者 | Gong, Wenjuan |
| 作者单位 | 1.Autonomous Univ Barcelona, Comp Vis Ctr, Edificio O,Campus UAB Bellaterra Cerdanyola, Barcelona, Spain 2.ASTAR, Inst High Performance Comp, 1 Fusionopolis Way,16-16 Connexis North Tower, Singapore, Singapore 3.Chinese Acad Sci, Inst Automat, 95 Zhongguancun East Rd, Beijing, Peoples R China 4.China Univ Petr East China, 66 Changjiangxi Rd, Qingdao, Peoples R China |
| 推荐引用方式 GB/T 7714 | Gong, Wenjuan,Zhang, Yue,Wang, Wei,et al. Meta-MMFNet: Meta-learning-based Multi-model Fusion Network for Micro-expression Recognition[J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS,2024,20(2):20. |
| APA | Gong, Wenjuan,Zhang, Yue,Wang, Wei,Cheng, Peng,&Gonzalez, Jordi.(2024).Meta-MMFNet: Meta-learning-based Multi-model Fusion Network for Micro-expression Recognition.ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS,20(2),20. |
| MLA | Gong, Wenjuan,et al."Meta-MMFNet: Meta-learning-based Multi-model Fusion Network for Micro-expression Recognition".ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS 20.2(2024):20. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。