CAS(ME)3: A Third Generation Facial Spontaneous Micro-Expression Database With Depth Information and High Ecological Validity
文献类型:期刊论文
作者 | Li, Jingting5; Dong, Zizhao5; Lu, Shaoyuan4,5; Wang, Su-Jing4,5; Yan, Wen-Jing3; Ma, Yinhuan2; Liu, Ye1,4; Huang, Changbing4,5; Fu, Xiaolan1,4 |
刊名 | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE |
出版日期 | 2023-03-01 |
卷号 | 45期号:3页码:2782-2800 |
ISSN号 | 0162-8828 |
关键词 | Databases Psychology Face recognition Videos Iron Emotion recognition Trajectory Micro-expression micro-expression databases CASME depth information ecological validity multi-modality |
DOI | 10.1109/TPAMI.2022.3174895 |
通讯作者 | Wang, Su-Jing(wangsujing@psych.ac.cn) ; Fu, Xiaolan(fuxl@psych.ac.cn) |
英文摘要 | Micro-expression (ME) is a significant non-verbal communication clue that reveals one person's genuine emotional state. The development of micro-expression analysis (MEA) has just gained attention in the last decade. However, the small sample size problem constrains the use of deep learning on MEA. Besides, ME samples distribute in six different databases, leading to database bias. Moreover, the ME database development is complicated. In this article, we introduce a large-scale spontaneous ME database: CAS(ME)(3). The contribution of this article is summarized as follows: (1) CAS(ME)(3) offers around 80 hours of videos with over 8,000,000 frames, including manually labeled 1,109 MEs and 3,490 macro-expressions. Such a large sample size allows effective MEA method validation while avoiding database bias. (2) Inspired by psychological experiments, CAS(ME)(3) provides the depth information as an additional modality unprecedentedly, contributing to multi-modal MEA. (3) For the first time, CAS(ME)(3) elicits ME with high ecological validity using the mock crime paradigm, along with physiological and voice signals, contributing to practical MEA. (4) Besides, CAS(ME)(3) provides 1,508 unlabeled videos with more than 4,000,000 frames, i.e., a data platform for unsupervised MEA methods. (5) Finally, we demonstrate the effectiveness of depth information by the proposed depth flow algorithm and RGB-D information. |
收录类别 | SCI |
WOS关键词 | RECOGNITION ; RESPONSES |
资助项目 | National Natural Science Foundation of China[U19B2032] ; National Natural Science Foundation of China[61772511] ; National Natural Science Foundation of China[62106256] ; National Natural Science Foundation of China[62061136001] ; China Postdoctoral Science Foundation[2020M680738] ; National Key Research and Development Project[2018AAA0100205] |
WOS研究方向 | Computer Science ; Engineering |
语种 | 英语 |
出版者 | IEEE COMPUTER SOC |
WOS记录号 | WOS:000966955800001 |
资助机构 | National Natural Science Foundation of China ; China Postdoctoral Science Foundation ; National Key Research and Development Project |
源URL | [http://ir.psych.ac.cn/handle/311026/46489] |
专题 | 心理研究所_中国科学院行为科学重点实验室 |
通讯作者 | Wang, Su-Jing; Fu, Xiaolan |
作者单位 | 1.Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China 2.Jiangsu Univ Sci & Technol, Sch Comp Sci, Zhenjiang 212100, Jiangsu, Peoples R China 3.Wenzhou Med Univ, Sch Mental Hlth, Wenzhou 325035, Zhejiang, Peoples R China 4.Univ Chinese Acad Sci, Dept Psychol, Beijing 100049, Peoples R China 5.Chinese Acad Sci, Inst Psychol, Key Lab Behav Sci, Beijing 100101, Peoples R China |
推荐引用方式 GB/T 7714 | Li, Jingting,Dong, Zizhao,Lu, Shaoyuan,et al. CAS(ME)3: A Third Generation Facial Spontaneous Micro-Expression Database With Depth Information and High Ecological Validity[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2023,45(3):2782-2800. |
APA | Li, Jingting.,Dong, Zizhao.,Lu, Shaoyuan.,Wang, Su-Jing.,Yan, Wen-Jing.,...&Fu, Xiaolan.(2023).CAS(ME)3: A Third Generation Facial Spontaneous Micro-Expression Database With Depth Information and High Ecological Validity.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,45(3),2782-2800. |
MLA | Li, Jingting,et al."CAS(ME)3: A Third Generation Facial Spontaneous Micro-Expression Database With Depth Information and High Ecological Validity".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 45.3(2023):2782-2800. |
入库方式: OAI收割
来源:心理研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。