An Occlusion-Aware Framework for Real-Time 3D Pose Tracking
文献类型:期刊论文
作者 | Fu ML(付明亮)1,3![]() ![]() ![]() |
刊名 | SENSORS
![]() |
出版日期 | 2018 |
卷号 | 18期号:8页码:1-20 |
关键词 | Pose Tracking Occlusion Handling Online Rendering Motion Compensation |
ISSN号 | 1424-8220 |
产权排序 | 1 |
英文摘要 | Random forest-based methods for 3D temporal tracking over an image sequence have gained increasing prominence in recent years. They do not require object’s texture and only use the raw depth images and previous pose as input, which makes them especially suitable for textureless objects. These methods learn a built-in occlusion handling from predetermined occlusion patterns, which are not always able to model the real case. Besides, the input of random forest is mixed with more and more outliers as the occlusion deepens. In this paper, we propose an occlusion-aware framework capable of real-time and robust 3D pose tracking from RGB-D images. To this end, the proposed framework is anchored in the random forest-based learning strategy, referred to as RFtracker. We aim to enhance its performance from two aspects: integrated local refinement of random forest on one side, and online rendering based occlusion handling on the other. In order to eliminate the inconsistency between learning and prediction of RFtracker, a local refinement step is embedded to guide random forest towards the optimal regression. Furthermore, we present an online rendering-based occlusion handling to improve the robustness against dynamic occlusion. Meanwhile, a lightweight convolutional neural network-based motion-compensated (CMC) module is designed to cope with fast motion and inevitable physical delay caused by imaging frequency and data transmission. Finally, experiments show that our proposed framework can cope better with heavily-occluded scenes than RFtracker and preserve the real-time performance. |
WOS关键词 | OBJECT TRACKING ; LIBRARY |
资助项目 | National Science Foundation of China[51505470] |
WOS研究方向 | Chemistry ; Electrochemistry ; Instruments & Instrumentation |
语种 | 英语 |
WOS记录号 | WOS:000445712400334 |
资助机构 | National Science Foundation of China |
源URL | [http://119.78.100.139/handle/173321/22395] ![]() |
专题 | 沈阳自动化研究所_空间自动化技术研究室 |
通讯作者 | Fu ML(付明亮) |
作者单位 | 1.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China 2.Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen 518055, China 3.University of Chinese Academy of Sciences, Beijing 100049, China |
推荐引用方式 GB/T 7714 | Fu ML,Leng YQ,Luo HT. An Occlusion-Aware Framework for Real-Time 3D Pose Tracking[J]. SENSORS,2018,18(8):1-20. |
APA | Fu ML,Leng YQ,&Luo HT.(2018).An Occlusion-Aware Framework for Real-Time 3D Pose Tracking.SENSORS,18(8),1-20. |
MLA | Fu ML,et al."An Occlusion-Aware Framework for Real-Time 3D Pose Tracking".SENSORS 18.8(2018):1-20. |
入库方式: OAI收割
来源:沈阳自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。