A CNN-Transformer Hybrid Recognition Approach for sEMG-Based Dynamic Gesture Prediction
文献类型：期刊论文
| 作者 | Liu, Yanhong1 ; Li, Xingyu1; Yang, Lei1; Bian, Guibin3,4; Yu, Hongnian1,2
|
| 刊名 | IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
 |
| 出版日期 | 2023 |
| 卷号 | 72页码:16 |
| 关键词 | Feature extraction Gesture recognition Task analysis Transformers Time-frequency analysis Convolution Data mining Convolutional neural network (CNN) feature fusion hand gesture recognition surface electromyography (sEMG) sensor transformer |
| ISSN号 | 0018-9456 |
| DOI | 10.1109/TIM.2023.3273651 |
| 通讯作者 | Yang, Lei(leiyang2019@zzu.edu.cn) |
| 英文摘要 | As a unique physiological electrical signal in the human body, surface electromyography (sEMG) signals always include human movement intention and muscle state. Through the collection of sEMG signals, different gestures can be effectively recognized. At present, the convolutional neural network (CNN) has been widely applied to different gesture recognition systems. However, due to its inherent limitations in global context feature extraction, it exists a certain shortcoming on high-precision prediction tasks. To solve this issue, a CNN-transformer hybrid recognition approach is proposed for high-precision dynamic gesture prediction. In addition, the continuous wavelet transform (CWT) is proposed for to acquire the time-frequency maps. To realize effective feature representation of local features from the time-frequency maps, an attention fusion block (AFB) is proposed to build the deep CNN network branch to effectively extract key channel information and spatial information from local features. Faced with the inherent limitations in global context feature extraction of CNNs, a transformer network branch is proposed to model the global relationship between pixels, called convolution and transformer (CAT) network branch. In addition, a multiscale feature attention (MFA) block is proposed for effective feature aggregation of local features and global contexts by learning adaptive multiscale features and suppressing irrelevant scale information. The experimental results on the established multichannel sEMG signal time-frequency map dataset show that the proposed CNN transformer hybrid recognition network has competitive recognition performance compared with other state-of-the-art recognition networks, and the average recognition speed of each spectrogram on the test set is only 14.7 ms. The proposed network can effectively improve network performance and identification efficiency. |
| WOS关键词 | HAND ; SIGNALS ; ROBUST |
| 资助项目 | National Key Research and Development Project of China[2020YFB1313701] ; National Natural Science Foundation of China[62003309] ; Outstanding Foreign Scientist Support Project in Henan Province of China[GZS2019008] |
| WOS研究方向 | Engineering ; Instruments & Instrumentation |
| 语种 | 英语 |
| WOS记录号 | WOS:001000275700017 |
| 出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| 资助机构 | National Key Research and Development Project of China ; National Natural Science Foundation of China ; Outstanding Foreign Scientist Support Project in Henan Province of China |
| 源URL | [http://ir.ia.ac.cn/handle/173211/53543]  |
| 专题 | 多模态人工智能系统全国重点实验室 |
| 通讯作者 | Yang, Lei |
| 作者单位 | 1.Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Henan, Peoples R China 2.Edinburgh Napier Univ, Sch Engn & Built Environm, Edinburgh EH10 5DT, Scotland 3.Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China 4.Zhengzhou Univ, Sch Elect Engn, Zhengzhou 450001, Henan, Peoples R China |
| 推荐引用方式 GB/T 7714 | Liu, Yanhong,Li, Xingyu,Yang, Lei,et al. A CNN-Transformer Hybrid Recognition Approach for sEMG-Based Dynamic Gesture Prediction[J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT,2023,72:16. |
| APA | Liu, Yanhong,Li, Xingyu,Yang, Lei,Bian, Guibin,&Yu, Hongnian.(2023).A CNN-Transformer Hybrid Recognition Approach for sEMG-Based Dynamic Gesture Prediction.IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT,72,16. |
| MLA | Liu, Yanhong,et al."A CNN-Transformer Hybrid Recognition Approach for sEMG-Based Dynamic Gesture Prediction".IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT 72(2023):16. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。