中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
An Occlusion-Aware Framework for Real-Time 3D Pose Tracking

文献类型:期刊论文

作者Fu ML(付明亮)1,3; Leng YQ(冷雨泉)2; Luo HT(骆海涛)1
刊名SENSORS
出版日期2018
卷号18期号:8页码:1-20
关键词Pose Tracking Occlusion Handling Online Rendering Motion Compensation
ISSN号1424-8220
产权排序1
英文摘要

Random forest-based methods for 3D temporal tracking over an image sequence have gained increasing prominence in recent years. They do not require object’s texture and only use the raw depth images and previous pose as input, which makes them especially suitable for textureless objects. These methods learn a built-in occlusion handling from predetermined occlusion patterns, which are not always able to model the real case. Besides, the input of random forest is mixed with more and more outliers as the occlusion deepens. In this paper, we propose an occlusion-aware framework capable of real-time and robust 3D pose tracking from RGB-D images. To this end, the proposed framework is anchored in the random forest-based learning strategy, referred to as RFtracker. We aim to enhance its performance from two aspects: integrated local refinement of random forest on one side, and online rendering based occlusion handling on the other. In order to eliminate the inconsistency between learning and prediction of RFtracker, a local refinement step is embedded to guide random forest towards the optimal regression. Furthermore, we present an online rendering-based occlusion handling to improve the robustness against dynamic occlusion. Meanwhile, a lightweight convolutional neural network-based motion-compensated (CMC) module is designed to cope with fast motion and inevitable physical delay caused by imaging frequency and data transmission. Finally, experiments show that our proposed framework can cope better with heavily-occluded scenes than RFtracker and preserve the real-time performance.

WOS关键词OBJECT TRACKING ; LIBRARY
资助项目National Science Foundation of China[51505470]
WOS研究方向Chemistry ; Electrochemistry ; Instruments & Instrumentation
语种英语
WOS记录号WOS:000445712400334
资助机构National Science Foundation of China
源URL[http://119.78.100.139/handle/173321/22395]  
专题沈阳自动化研究所_空间自动化技术研究室
通讯作者Fu ML(付明亮)
作者单位1.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
2.Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen 518055, China
3.University of Chinese Academy of Sciences, Beijing 100049, China
推荐引用方式
GB/T 7714
Fu ML,Leng YQ,Luo HT. An Occlusion-Aware Framework for Real-Time 3D Pose Tracking[J]. SENSORS,2018,18(8):1-20.
APA Fu ML,Leng YQ,&Luo HT.(2018).An Occlusion-Aware Framework for Real-Time 3D Pose Tracking.SENSORS,18(8),1-20.
MLA Fu ML,et al."An Occlusion-Aware Framework for Real-Time 3D Pose Tracking".SENSORS 18.8(2018):1-20.

入库方式: OAI收割

来源:沈阳自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。