中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Appearance-Based Gaze Estimator for Natural Interaction Control of Surgical Robots

文献类型:期刊论文

作者Li P(李鹏); Hou, Xuebin; Duan, Xingguang; Yip, Hiuman; Song GL(宋国立); Liu YH(刘云会)
刊名IEEE ACCESS
出版日期2019
卷号7页码:25095-25110
关键词Deep learning surgical robot gaze estimation convolutional neural network
ISSN号2169-3536
产权排序4
英文摘要

Robots are playing an increasingly important role in modern surgery. However, conventional human-computer interaction methods, such as joystick control and sound control, have some shortcomings, and medical personnel are required to specifically practice operating the robot. We propose a human-computer interaction model based on eye movement with which medical staff can conveniently use their eye movements to control the robot. Our algorithm requires only an RGB camera to perform tasks without requiring expensive eye-tracking devices. Two kinds of eye control modes are designed in this paper. The first type is the pick and place movement, with which the user uses eye gaze to specify the point where the robotic arm is required to move. The second type is user command movement, with which the user can use eye gaze to select the direction in which the user desires the robot to move. The experimental results demonstrate the feasibility and convenience of these two modes of movement.

WOS关键词CALIBRATION
资助项目National Natural Science Foundation of China through the Shenzhen Robot Research Program[U1613221] ; Shenzhen Fundamental Research[JCYJ20170307150346964] ; Guangdong Provincial Science and Technology Funds[2017A020211001] ; National Key Research and Development Program of China[2017YFB1302800]
WOS研究方向Computer Science ; Engineering ; Telecommunications
语种英语
WOS记录号WOS:000461014500001
源URL[http://ir.sia.cn/handle/173321/24414]  
专题沈阳自动化研究所_空间自动化技术研究室
通讯作者Song GL(宋国立)
作者单位1.School of Mechanical Engineering and Automation, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, China
2.School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
3.Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong
4.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
推荐引用方式
GB/T 7714
Li P,Hou, Xuebin,Duan, Xingguang,et al. Appearance-Based Gaze Estimator for Natural Interaction Control of Surgical Robots[J]. IEEE ACCESS,2019,7:25095-25110.
APA Li P,Hou, Xuebin,Duan, Xingguang,Yip, Hiuman,Song GL,&Liu YH.(2019).Appearance-Based Gaze Estimator for Natural Interaction Control of Surgical Robots.IEEE ACCESS,7,25095-25110.
MLA Li P,et al."Appearance-Based Gaze Estimator for Natural Interaction Control of Surgical Robots".IEEE ACCESS 7(2019):25095-25110.

入库方式: OAI收割

来源:沈阳自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。