Multistep Deep System for Multimodal Emotion Detection With Invalid Data in the Internet of Things
文献类型：期刊论文
| 作者 | Li, Minjia3; Xie, Lun3; Lv, Zeping1; Li, Juan2 ; Wang, Zhiliang3
|
| 刊名 | IEEE ACCESS
 |
| 出版日期 | 2020 |
| 卷号 | 8页码:187208-187221 |
| 关键词 | Feature extraction Internet of Things Semantics Databases Task analysis Emotion recognition Biomedical monitoring Internet of Things multimodal emotion detection invalid data multi-step deep (MSD) system deep neural networks |
| ISSN号 | 2169-3536 |
| DOI | 10.1109/ACCESS.2020.3029288 |
| 通讯作者 | Xie, Lun(xielun@ustb.edu.cn) |
| 英文摘要 | The Internet of Things (IoT) technologies such as interconnection and edge computing help emotion recognition to be applied in healthcare, smart education, etc. However, the acquisition and transmission processes may have some situations, such as lost signals and serious interference noise caused by motion, which affect the quality of the received data and limit the performance of IoT emotion detection. We collectively refer to these as invalid data. A multi-step deep (MSD) system is proposed to reliably detect multimodal emotion by the collected records containing invalid data. Semantic compatibility and continuity are utilized to filter out the invalid data. The feature from invalid modal data is replaced through the imputation method to compensate for the impact of invalid data on emotion detection. In this way, the proposed system can automatically process invalid data and improve the recognition performance. Furthermore, considering the spatiotemporal information, the features of video and physiological signals are extracted by specific deep neural networks in the MSD system. The simulation experiments are conducted on a public multimodal database, and the performance of the MSD system measured by the unweighted average recall is better than that of the traditional system. The promising results observed in the experiments verify the potential influence of the proposed system in practical IoT applications. |
| WOS关键词 | HEALTH-CARE IOT ; COMPUTATION |
| 资助项目 | National Key Research and Development Program of China[2018YFC2001700] ; National Natural Science Foundation of China (Normal Project)[61672093] ; Beijing Municipal Natural Science Foundation[L192005] |
| WOS研究方向 | Computer Science ; Engineering ; Telecommunications |
| 语种 | 英语 |
| WOS记录号 | WOS:000583561000001 |
| 出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| 资助机构 | National Key Research and Development Program of China ; National Natural Science Foundation of China (Normal Project) ; Beijing Municipal Natural Science Foundation |
| 源URL | [http://ir.psych.ac.cn/handle/311026/33374]  |
| 专题 | 心理研究所_认知与发展心理学研究室 |
| 通讯作者 | Xie, Lun |
| 作者单位 | 1.Rehabil Hosp, Natl Rehabil Auxiliary Ctr, Beijing 100176, Peoples R China 2.Chinese Acad Sci, Inst Psychol, Beijing 100101, Peoples R China 3.Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China |
| 推荐引用方式 GB/T 7714 | Li, Minjia,Xie, Lun,Lv, Zeping,et al. Multistep Deep System for Multimodal Emotion Detection With Invalid Data in the Internet of Things[J]. IEEE ACCESS,2020,8:187208-187221. |
| APA | Li, Minjia,Xie, Lun,Lv, Zeping,Li, Juan,&Wang, Zhiliang.(2020).Multistep Deep System for Multimodal Emotion Detection With Invalid Data in the Internet of Things.IEEE ACCESS,8,187208-187221. |
| MLA | Li, Minjia,et al."Multistep Deep System for Multimodal Emotion Detection With Invalid Data in the Internet of Things".IEEE ACCESS 8(2020):187208-187221. |
入库方式： OAI收割
来源：心理研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。