A Visual-Based Gesture Prediction Framework Applied in Social Robots
文献类型：期刊论文
| 作者 | Bixiao Wu; Junpei Zhong; Chenguang Yang |
| 刊名 | IEEE/CAA Journal of Automatica Sinica
 |
| 出版日期 | 2022 |
| 卷号 | 9期号:3页码:510-519 |
| 关键词 | Finger-guessing game gesture prediction human-robot interaction long-short time memory recurrent neural network (LSTM-RNN) social robot |
| ISSN号 | 2329-9266 |
| DOI | 10.1109/JAS.2021.1004243 |
| 英文摘要 | In daily life, people use their hands in various ways for most daily activities. There are many applications based on the position, direction, and joints of the hand, including gesture recognition, gesture prediction, robotics and so on. This paper proposes a gesture prediction system that uses hand joint coordinate features collected by the Leap Motion to predict dynamic hand gestures. The model is applied to the NAO robot to verify the effectiveness of the proposed method. First of all, in order to reduce jitter or jump generated in the process of data acquisition by the Leap Motion, the Kalman filter is applied to the original data. Then some new feature descriptors are introduced. The length feature, angle feature and angular velocity feature are extracted from the filtered data. These features are fed into the long-short time memory recurrent neural network (LSTM-RNN) with different combinations. Experimental results show that the combination of coordinate, length and angle features achieves the highest accuracy of 99.31%, and it can also run in real time. Finally, the trained model is applied to the NAO robot to play the finger-guessing game. Based on the predicted gesture, the NAO robot can respond in advance. |
| 源URL | [http://ir.ia.ac.cn/handle/173211/47211]  |
| 专题 | 自动化研究所_学术期刊_IEEE/CAA Journal of Automatica Sinica |
| 推荐引用方式 GB/T 7714 | Bixiao Wu,Junpei Zhong,Chenguang Yang. A Visual-Based Gesture Prediction Framework Applied in Social Robots[J]. IEEE/CAA Journal of Automatica Sinica,2022,9(3):510-519. |
| APA | Bixiao Wu,Junpei Zhong,&Chenguang Yang.(2022).A Visual-Based Gesture Prediction Framework Applied in Social Robots.IEEE/CAA Journal of Automatica Sinica,9(3),510-519. |
| MLA | Bixiao Wu,et al."A Visual-Based Gesture Prediction Framework Applied in Social Robots".IEEE/CAA Journal of Automatica Sinica 9.3(2022):510-519. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。