中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 自动化研究所
  3. 中国科学院自动化研究所
  4. 多模态人工智能系统全国重点实验室
Dual Attention and Element Recalibration Networks for Automatic Depression Level Prediction

文献类型：期刊论文

作者Niu, Mingyue2; Zhao, Ziping2; Tao, Jianhua1,3,4; Li, Ya5; Schuller, Bjorn6,7
刊名IEEE TRANSACTIONS ON AFFECTIVE COMPUTING
出版日期2023-07-01
卷号14期号:3页码:1954-1965
ISSN号1949-3045
关键词Depression Feature extraction Tensors Databases Spatiotemporal phenomena Convolutional neural networks Physiology DAER network depression level prediction dual attention block element recalibration block facial differences
DOI10.1109/TAFFC.2022.3177737
通讯作者Zhao, Ziping(ztianjin@126.com) ; Tao, Jianhua(jhtao@nlpr.ia.ac.cn)
英文摘要Physiological studies have identified that facial dynamics can be considered as biomarkers to analyze depression severity. This paper accordingly develops a Dual Attention and Element Recalibration (DAER) network to extract facial changes to predict the depression level. In this model, we propose two blocks: a Dual Attention (DA) block and Element Recalibration (ER) block. The DA block uses the self-attention to investigate the dynamic changes in the representation sequence of a facial video segment. It further examines the influence of feature components of the representation sequence on depression level prediction through bilinear-attention. Moreover, to improve the representation ability of network, the ER block is used to obtain the global information to recalibrate each element of the tensor. Adopting this approach, for the depression level prediction task, we first divide the long-term video into fixed-length segments and use the trained ResNet50 to encode each frame to generate the representation sequences of video segments. Second, the representation sequences are input into DAER network to obtain the depression level scores. Finally, the average of these scores yields the prediction result corresponding to the long-term video. Experiments on publicly available AVEC 2013 and AVEC 2014 depression databases illustrate the effectiveness of our method.
WOS关键词FACIAL APPEARANCE ; RECOGNITION
资助项目Open Project Program of the National Laboratory of Pattern Recognition (NLPR) ; National Natural Science Foundation of China[202200012] ; New Talent Project of Beijing University of Posts and Telecommunications[62071330] ; Open Project Program of the National Laboratory of Pattern Recognition (NLPR) ; National Natural Science Foundation of China[202200012] ; New Talent Project of Beijing University of Posts and Telecommunications[62071330] ; [2021RC37]
WOS研究方向Computer Science
语种英语
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号WOS:001075041900019
资助机构Open Project Program of the National Laboratory of Pattern Recognition (NLPR) ; National Natural Science Foundation of China ; New Talent Project of Beijing University of Posts and Telecommunications ; Open Project Program of the National Laboratory of Pattern Recognition (NLPR) ; National Natural Science Foundation of China ; New Talent Project of Beijing University of Posts and Telecommunications
源URL[http://ir.ia.ac.cn/handle/173211/52996]  
专题多模态人工智能系统全国重点实验室
通讯作者Zhao, Ziping; Tao, Jianhua
作者单位1.CAS Ctr Excellence Brain Sci & Intelligence Techno, Beijing 100190, Peoples R China
2.Tianjin Normal Univ TJNU, Sch Comp & Informat Engn, Tianjin 300387, Peoples R China
3.Inst Automat Chinese Acad Sci CASIA, Natl Lab Pattern Recognit NLPR, Beijing 100190, Peoples R China
4.Univ Chinese Acad Sci UCAS, Sch Artificial Intelligence, Beijing 100049, Peoples R China
5.Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
6.Univ Augsburg, ZD B Chair Embedded Intelligence Hlth Care & Wellb, D-86159 Augsburg, Germany
7.Imperial Coll London, GLAM Grp Language Audio & Mus, London SW7 2BX, England
推荐引用方式
GB/T 7714		 Niu, Mingyue,Zhao, Ziping,Tao, Jianhua,et al. Dual Attention and Element Recalibration Networks for Automatic Depression Level Prediction[J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING,2023,14(3):1954-1965.
APA Niu, Mingyue,Zhao, Ziping,Tao, Jianhua,Li, Ya,&Schuller, Bjorn.(2023).Dual Attention and Element Recalibration Networks for Automatic Depression Level Prediction.IEEE TRANSACTIONS ON AFFECTIVE COMPUTING,14(3),1954-1965.
MLA Niu, Mingyue,et al."Dual Attention and Element Recalibration Networks for Automatic Depression Level Prediction".IEEE TRANSACTIONS ON AFFECTIVE COMPUTING 14.3(2023):1954-1965.

入库方式： OAI收割

来源：自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。