中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Continuous multimodal emotion prediction based on long short term memory recurrent neural network

文献类型:会议论文

作者Jian Huang2,3; Ya Li3; Jianhua Tao1,2,3; Zheng Lian2,3; Zhengqi Wen3; Minghao Yang3; Jianyan Yi2,3; Lian, Zheng; Huang, Jian; Li, Ya
出版日期2017-10
会议日期2017.10.23-2017.10.27
会议地点Mountain View, CA, USA
英文摘要

The continuous dimensional emotion can depict subtlety and complexity of emotional change, which is an inherently challenging problem with growing attention. This paper presents our automatic prediction of dimensional emotional state for Audio-Visual Emotion Challenge (AVEC 2017), which uses multi-features and fusion across all available modalities. Besides the baseline features provided by the organizers, we also extract other acoustic audio feature sets, appearance features and deep visual features as complementary features. Each type of feature is trained using Long Short-Term Memory Recurrent Neutral Network (LSTM-RNN) for every dimensional emotion prediction separately considering annotation delay and temporal pooling. To overcome overfitting problem, robust models are chosen carefully for individual model. Finally, multimodal emotionfusion is achieved by utilizing Support Vector Regression (SVR) with the estimates from different feature sets in decision level fusion. The experimental results indicate that our extracted features are beneficial to performance improvement and our system design achieves very promising results with Concordant Correlation Coefficient (CCC), which outperform the baseline system on the testing set for arousal of 0.599 vs 0.375 (baseline) and for valence of 0.721 vs 0.466 and for liking 0.295 vs 0.246.

语种英语
源URL[http://ir.ia.ac.cn/handle/173211/39304]  
专题模式识别国家重点实验室_智能交互
作者单位1.CAS Center for Excellence in Brain Science and Intelligence Technology, Beijing, China
2.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
3.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
推荐引用方式
GB/T 7714
Jian Huang,Ya Li,Jianhua Tao,et al. Continuous multimodal emotion prediction based on long short term memory recurrent neural network[C]. 见:. Mountain View, CA, USA. 2017.10.23-2017.10.27.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。