A Study of Using Synthetic Data for Effective Association Knowledge Learning
文献类型:期刊论文
作者 | Yuchi Liu1; Zhongdao Wang2; Xiangxin Zhou2; Liang Zheng1 |
刊名 | Machine Intelligence Research
![]() |
出版日期 | 2023 |
卷号 | 20期号:2页码:194-206 |
关键词 | Multi-object tracking (MOT) data association synthetic data motion simulation association knowledge learning |
ISSN号 | 2731-538X |
DOI | 10.1007/s11633-022-1380-x |
英文摘要 | Association, aiming to link bounding boxes of the same identity in a video sequence, is a central component in multi-object tracking (MOT). To train association modules, e.g., parametric networks, real video data are usually used. However, annotating person tracks in consecutive video frames is expensive, and such real data, due to its inflexibility, offer us limited opportunities to evaluate the system performance w.r.t. changing tracking scenarios. In this paper, we study whether 3D synthetic data can replace real-world videos for association training. Specifically, we introduce a large-scale synthetic data engine named MOTX, where the motion characteristics of cameras and objects are manually configured to be similar to those of real-world datasets. We show that, compared with real data, association knowledge obtained from synthetic data can achieve very similar performance on real-world test sets without domain adaption techniques. Our intriguing observation is credited to two factors. First and foremost, 3D engines can well simulate motion factors such as camera movement, camera view, and object movement so that the simulated videos can provide association modules with effective motion features. Second, the experimental results show that the appearance domain gap hardly harms the learning of association knowledge. In addition, the strong customization ability of MOTX allows us to quantitatively assess the impact of motion factors on MOT, which brings new insights to the community. |
语种 | 英语 |
源URL | [http://ir.ia.ac.cn/handle/173211/55974] ![]() |
专题 | 自动化研究所_学术期刊_International Journal of Automation and Computing |
作者单位 | 1.College of Engineering & Computer Science, Australian National University, Canberra 2601, Australia 2.Department of Electronic Engineering, Tsinghua University, Beijing 100084, China |
推荐引用方式 GB/T 7714 | Yuchi Liu,Zhongdao Wang,Xiangxin Zhou,et al. A Study of Using Synthetic Data for Effective Association Knowledge Learning[J]. Machine Intelligence Research,2023,20(2):194-206. |
APA | Yuchi Liu,Zhongdao Wang,Xiangxin Zhou,&Liang Zheng.(2023).A Study of Using Synthetic Data for Effective Association Knowledge Learning.Machine Intelligence Research,20(2),194-206. |
MLA | Yuchi Liu,et al."A Study of Using Synthetic Data for Effective Association Knowledge Learning".Machine Intelligence Research 20.2(2023):194-206. |
入库方式: OAI收割
来源:自动化研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。