Foot placement prediction for assistive walking by fusing sequential 3D gaze and environmental context
文献类型:期刊论文
作者 | Zhang, Kuangen2,3,4; Liu, Haiyuan3,4; Fan, Zixuan1; Chen, Xinxing3,4; Leng YQ(冷雨泉)5![]() |
刊名 | IEEE Robotics and Automation Letters
![]() |
出版日期 | 2021 |
卷号 | 6期号:2页码:2509-2516 |
关键词 | 3D gaze foot placement prediction intention recognition prosthetics and exoskeletons sensor/data fusion |
ISSN号 | 2377-3766 |
产权排序 | 5 |
英文摘要 | Predicting the locomotion intent of humans is important for controlling assistive robots predictively. Previous studies have researched assistive walking on structured terrains, but few studies consider rough terrains. Human intent on rough terrains is more difficult to predict because the transition happens every step. To predict foot placements of humans on rough terrains, this paper fuses sequential 3D gazes and environmental context. The 3D gaze is assumed to be the intersection point of the line of sight measured by an eye-tracker and the environmental point cloud measured by an RGBD camera. The sequential 3D gazes and environmental context are fused based on an RGBD SLAM algorithm. Then the closest segmented terrain to the center of sequential 3D gazes is regarded as the most possible foothold area at the next step. Six able-bodied subjects participate in the experiments, and their foot placements can be accurately predicted 0.5 step ahead. With environmental context, the average classification accuracy and the distance error of predicting the foot placements can achieve 97% and 0.11 m. The user-dependent time window can further decrease the prediction error to 0.086 m. Without environmental context, the distance between the gaze center and the actual foot placement is higher than 0.18 m. Hence, both gazes and environmental context are important to predict human intent on rough terrains. |
语种 | 英语 |
资助机构 | National Key R&D Program of China under Grant 2018YFB1305400 ; National Natural Science Foundation of China under Grants U1913205 and 51805237 ; Guangdong Basic, and Applied Basic Research Foundation under Grant 2020B1515120098 ; Guangdong Innovative, and Entrepreneurial Research Team Program under Grant 2016ZT06G587 ; Shenzhen, and Hong Kong Innovation Circle Project under Grant SGLH20180619172011638 ; Centers for Mechanical Engineering Research, and Education at MIT, and SUSTech |
源URL | [http://ir.sia.cn/handle/173321/28502] ![]() |
专题 | 沈阳自动化研究所_空间自动化技术研究室 |
通讯作者 | Fu, Chenglong |
作者单位 | 1.School of Modern Post, Beijing University of Posts and Telecommunications, Beijing 100876, China 2.Department of Mechanical Engineering, The University of British Columbia, Vancouver, BC V6T1Z4,Canada 3.Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen 518055, China 4.Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems and Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen 518055, China 5.State Key Laboratory of Robotics, Shenyang Institute of Automation, Shenyang 110016, China |
推荐引用方式 GB/T 7714 | Zhang, Kuangen,Liu, Haiyuan,Fan, Zixuan,et al. Foot placement prediction for assistive walking by fusing sequential 3D gaze and environmental context[J]. IEEE Robotics and Automation Letters,2021,6(2):2509-2516. |
APA | Zhang, Kuangen.,Liu, Haiyuan.,Fan, Zixuan.,Chen, Xinxing.,Leng YQ.,...&Fu, Chenglong.(2021).Foot placement prediction for assistive walking by fusing sequential 3D gaze and environmental context.IEEE Robotics and Automation Letters,6(2),2509-2516. |
MLA | Zhang, Kuangen,et al."Foot placement prediction for assistive walking by fusing sequential 3D gaze and environmental context".IEEE Robotics and Automation Letters 6.2(2021):2509-2516. |
入库方式: OAI收割
来源:沈阳自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。