中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 自动化研究所
  3. 中国科学院自动化研究所
  4. 多模态人工智能系统全国重点实验室
  5. 多媒体计算与图形学团队
Multi-Target Multi-Camera Tracking With Optical-Based Pose Association

文献类型：期刊论文

作者You, Sisi1; Yao, Hantao2; Xu, Changsheng2,3
刊名IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
出版日期2021-08-01
卷号31期号:8页码:3105-3117
ISSN号1051-8215
关键词Target tracking Trajectory Cameras Visualization Feature extraction Proposals Object detection Multi-target multi-camera tracking pose estimation optical flow pose matching
DOI10.1109/TCSVT.2020.3036467
通讯作者Xu, Changsheng(csxu@nlpr.ia.ac.cn)
英文摘要Multi-target multi-camera tracking (MTMCT) targets to generate trajectories of the object that appeared under multiple cameras automatically. MTMCT can be treated as a combination of intra-camera tracking and cross-camera tracking. The existing work only employs the global description to perform the tracklet generating. However, the global description cannot model the local similarity between targets, leading to existing methods not to be robust to occlusion and fast motion. To handle the mentioned problem, we propose an online Optical-based Pose Association (OPA) for multi-target multi-camera tracking. The proposed method utilizes local pose matching to solve the occlusion problem, and applies optical flow to reduce the distance caused by fast motion. For optical-based pose association, we firstly employ OpenPose to generate human pose for each proposal. Then, we utilize the optical flow generated by PWC-Net to adjust the estimated pose for the previous frame. Finally, the modified Object Keypoint Similarity is used to compute the similarity between the pose of the current frame and adjusted pose in the prior frame. Once obtaining the optical-based pose similarity, we combine it with the visual and bounding box spatial similarities to generate the final similarity matrix, and apply the Kuhn-Munkras algorithm for data association. The experiments on the MTMCT and MOT datasets verify the rationality of using human pose information and prove the superiority of the proposed method.
WOS关键词APPEARANCE
资助项目National Key Research and Development Program of China[2018AAA0102200] ; National Natural Science Foundation of China[61902399] ; National Natural Science Foundation of China[61721004] ; National Natural Science Foundation of China[U1836220] ; National Natural Science Foundation of China[U1705262] ; National Natural Science Foundation of China[61532009] ; National Natural Science Foundation of China[61832002] ; National Natural Science Foundation of China[61720106006] ; Key Research Program of Frontier Sciences, Chinese Academy of Sciences (CAS)[QYZDJ-SSW-JSC039]
WOS研究方向Engineering
语种英语
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号WOS:000681222500017
资助机构National Key Research and Development Program of China ; National Natural Science Foundation of China ; Key Research Program of Frontier Sciences, Chinese Academy of Sciences (CAS)
源URL[http://ir.ia.ac.cn/handle/173211/45619]  
专题自动化研究所_模式识别国家重点实验室_多媒体计算与图形学团队
通讯作者Xu, Changsheng
作者单位1.Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
2.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
3.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
推荐引用方式
GB/T 7714		 You, Sisi,Yao, Hantao,Xu, Changsheng. Multi-Target Multi-Camera Tracking With Optical-Based Pose Association[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,2021,31(8):3105-3117.
APA You, Sisi,Yao, Hantao,&Xu, Changsheng.(2021).Multi-Target Multi-Camera Tracking With Optical-Based Pose Association.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,31(8),3105-3117.
MLA You, Sisi,et al."Multi-Target Multi-Camera Tracking With Optical-Based Pose Association".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 31.8(2021):3105-3117.

入库方式： OAI收割

来源：自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。