中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition

文献类型:期刊论文

作者Wang, Yuhao2; Xu, Hongji2; Zheng, Lina2; Zhao, Guozhen1; Liu, Zhi2; Zhou, Shuang2; Wang, Mengmeng2; Xu, Jie2
刊名IEEE Internet of Things Journal
出版日期2023
卷号10期号:16页码:14873-14885
通讯作者邮箱hongjixu@sdu.edu.cn (xu, hongji) ; liu, zhi
关键词Feature extraction Internet of Things Deep learning Monitoring Data mining Convolutional neural networks Wearable computer shuman activity recognition (HAR) leave-one-subject-out (LOSO) cross-validation (CV) multisource and multimodal sensor (MMS) data squeeze-and-excitation (SE) blocks tenfold CV
ISSN号2327-4662
DOI10.1109/JIOT.2023.3265937
产权排序2
文献子类综述
英文摘要

data-language="eng" data-ev-field="abstract">Human activity recognition (HAR) technology based on wearables has received increasing attention in recent years. The traditional methods have used hand-crafted features to recognize human activities, resulting in shallow feature extraction. With the development of deep learning, an increasing number of researchers have focused on studying deep learning methods. To achieve higher recognition accuracy, the majority of the current HAR research involves multisource and multimodal sensors (MMSs) data. However, due to the limitations in the receptive fields of single-dimensional convolutional kernels, these networks are still infeasible for extracting spatiotemporal features. In this study, a multidimensional parallel convolutional connected (MPCC) deep learning network based on MMS data for HAR is proposed that fully utilizes the advantages of multidimensional convolutional kernels. Moreover, multiscale residual convolutional squeeze-and-excitation (MRCSE) modules are proposed to enrich the diversity of feature information by combining squeeze-and-excitation (SE) blocks. A daily home activity (DHA) data set is constructed based on the requirements for HAR in certain scenarios, such as smart home, and we conduct experiments on the optimal combination of sensor locations on the DHA data set according to a weighted F1∼(FW)-score. Both tenfold and leave-one-subject-out (LOSO) cross-validations (CVs) are used to evaluate the performance of the proposed network. The MPCC-MRCSE network achieves FW-scores of 98.33% and 95.42% on the physical activity monitoring for aging people (PAMAP2) and OPPORTUNITY data sets using tenfold CVs, respectively, and achieves FW-scores of 81.47% on the PAMAP2 when applying an LOSO CV.

收录类别SCI ; EI
语种英语
源URL[http://ir.psych.ac.cn/handle/311026/48248]  
专题心理研究所_中国科学院行为科学重点实验室
通讯作者Xu, Hongji
作者单位1.Chinese Academy of Sciences, Department of Psychology, Beijing; 100049, China
2.Shandong University, School of Information Science and Engineering, Qingdao; 266237, China
推荐引用方式
GB/T 7714
Wang, Yuhao,Xu, Hongji,Zheng, Lina,et al. A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition[J]. IEEE Internet of Things Journal,2023,10(16):14873-14885.
APA Wang, Yuhao.,Xu, Hongji.,Zheng, Lina.,Zhao, Guozhen.,Liu, Zhi.,...&Xu, Jie.(2023).A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition.IEEE Internet of Things Journal,10(16),14873-14885.
MLA Wang, Yuhao,et al."A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition".IEEE Internet of Things Journal 10.16(2023):14873-14885.

入库方式: OAI收割

来源:心理研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。