中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A Study of Using Synthetic Data for Effective Association Knowledge Learning

文献类型:期刊论文

作者Yuchi Liu1; Zhongdao Wang2; Xiangxin Zhou2; Liang Zheng1
刊名Machine Intelligence Research
出版日期2023
卷号20期号:2页码:194-206
关键词Multi-object tracking (MOT) data association synthetic data motion simulation association knowledge learning
ISSN号2731-538X
DOI10.1007/s11633-022-1380-x
英文摘要

Association, aiming to link bounding boxes of the same identity in a video sequence, is a central component in multi-object tracking (MOT). To train association modules, e.g., parametric networks, real video data are usually used. However, annotating person tracks in consecutive video frames is expensive, and such real data, due to its inflexibility, offer us limited opportunities to evaluate the system performance w.r.t. changing tracking scenarios. In this paper, we study whether 3D synthetic data can replace real-world videos for association training. Specifically, we introduce a large-scale synthetic data engine named MOTX, where the motion characteristics of cameras and objects are manually configured to be similar to those of real-world datasets. We show that, compared with real data, association knowledge obtained from synthetic data can achieve very similar performance on real-world test sets without domain adaption techniques. Our intriguing observation is credited to two factors. First and foremost, 3D engines can well simulate motion factors such as camera movement, camera view, and object movement so that the simulated videos can provide association modules with effective motion features. Second, the experimental results show that the appearance domain gap hardly harms the learning of association knowledge. In addition, the strong customization ability of MOTX allows us to quantitatively assess the impact of motion factors on MOT, which brings new insights to the community.

语种英语
源URL[http://ir.ia.ac.cn/handle/173211/55974]  
专题自动化研究所_学术期刊_International Journal of Automation and Computing
作者单位1.College of Engineering & Computer Science, Australian National University, Canberra 2601, Australia
2.Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
推荐引用方式
GB/T 7714
Yuchi Liu,Zhongdao Wang,Xiangxin Zhou,et al. A Study of Using Synthetic Data for Effective Association Knowledge Learning[J]. Machine Intelligence Research,2023,20(2):194-206.
APA Yuchi Liu,Zhongdao Wang,Xiangxin Zhou,&Liang Zheng.(2023).A Study of Using Synthetic Data for Effective Association Knowledge Learning.Machine Intelligence Research,20(2),194-206.
MLA Yuchi Liu,et al."A Study of Using Synthetic Data for Effective Association Knowledge Learning".Machine Intelligence Research 20.2(2023):194-206.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。