Continuous multimodal emotion prediction based on long short term memory recurrent neural network
文献类型:会议论文
作者 | Jian Huang2,3; Ya Li3; Jianhua Tao1,2,3; Zheng Lian2,3; Zhengqi Wen3; Minghao Yang3; Jianyan Yi2,3; Lian, Zheng![]() ![]() ![]() |
出版日期 | 2017-10 |
会议日期 | 2017.10.23-2017.10.27 |
会议地点 | Mountain View, CA, USA |
英文摘要 | The continuous dimensional emotion can depict subtlety and complexity of emotional change, which is an inherently challenging problem with growing attention. This paper presents our automatic prediction of dimensional emotional state for Audio-Visual Emotion Challenge (AVEC 2017), which uses multi-features and fusion across all available modalities. Besides the baseline features provided by the organizers, we also extract other acoustic audio feature sets, appearance features and deep visual features as complementary features. Each type of feature is trained using Long Short-Term Memory Recurrent Neutral Network (LSTM-RNN) for every dimensional emotion prediction separately considering annotation delay and temporal pooling. To overcome overfitting problem, robust models are chosen carefully for individual model. Finally, multimodal emotionfusion is achieved by utilizing Support Vector Regression (SVR) with the estimates from different feature sets in decision level fusion. The experimental results indicate that our extracted features are beneficial to performance improvement and our system design achieves very promising results with Concordant Correlation Coefficient (CCC), which outperform the baseline system on the testing set for arousal of 0.599 vs 0.375 (baseline) and for valence of 0.721 vs 0.466 and for liking 0.295 vs 0.246. |
语种 | 英语 |
源URL | [http://ir.ia.ac.cn/handle/173211/39304] ![]() |
专题 | 模式识别国家重点实验室_智能交互 |
作者单位 | 1.CAS Center for Excellence in Brain Science and Intelligence Technology, Beijing, China 2.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China 3.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China |
推荐引用方式 GB/T 7714 | Jian Huang,Ya Li,Jianhua Tao,et al. Continuous multimodal emotion prediction based on long short term memory recurrent neural network[C]. 见:. Mountain View, CA, USA. 2017.10.23-2017.10.27. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。