A Weakly-Supervised Crowd Density Estimation Method Based on Two-Stage Linear Feature Calibration
文献类型：期刊论文
| 作者 | Yong-Chao Li; Rui-Sheng Jia; Ying-Xiang Hu; Hong-Mei Sun |
| 刊名 | IEEE/CAA Journal of Automatica Sinica
 |
| 出版日期 | 2024 |
| 卷号 | 11期号:4页码:965-981 |
| ISSN号 | 2329-9266 |
| 关键词 | Crowd density estimation linear feature calibration vision transformer weakly-supervision learning |
| DOI | 10.1109/JAS.2023.123960 |
| 英文摘要 | In a crowd density estimation dataset, the annotation of crowd locations is an extremely laborious task, and they are not taken into the evaluation metrics. In this paper, we aim to reduce the annotation cost of crowd datasets, and propose a crowd density estimation method based on weakly-supervised learning, in the absence of crowd position supervision information, which directly reduces the number of crowds by using the number of pedestrians in the image as the supervised information. For this purpose, we design a new training method, which exploits the correlation between global and local image features by incremental learning to train the network. Specifically, we design a parent-child network (PC-Net) focusing on the global and local image respectively, and propose a linear feature calibration structure to train the PC-Net simultaneously, and the child network learns feature transfer factors and feature bias weights, and uses the transfer factors and bias weights to linearly feature calibrate the features extracted from the Parent network, to improve the convergence of the network by using local features hidden in the crowd images. In addition, we use the pyramid vision transformer as the backbone of the PC-Net to extract crowd features at different levels, and design a global-local feature loss function (L2). We combine it with a crowd counting loss (LC) to enhance the sensitivity of the network to crowd features during the training process, which effectively improves the accuracy of crowd density estimation. The experimental results show that the PC-Net significantly reduces the gap between fully-supervised and weakly-supervised crowd density estimation, and outperforms the comparison methods on five datasets of ShanghaiTech Part A, ShanghaiTech Part B, UCF_CC_50, UCF_QNRF and JHU-CROWD++. |
| 源URL | [http://ir.ia.ac.cn/handle/173211/55370]  |
| 专题 | 自动化研究所_学术期刊_IEEE/CAA Journal of Automatica Sinica |
| 推荐引用方式 GB/T 7714 | Yong-Chao Li,Rui-Sheng Jia,Ying-Xiang Hu,et al. A Weakly-Supervised Crowd Density Estimation Method Based on Two-Stage Linear Feature Calibration[J]. IEEE/CAA Journal of Automatica Sinica,2024,11(4):965-981. |
| APA | Yong-Chao Li,Rui-Sheng Jia,Ying-Xiang Hu,&Hong-Mei Sun.(2024).A Weakly-Supervised Crowd Density Estimation Method Based on Two-Stage Linear Feature Calibration.IEEE/CAA Journal of Automatica Sinica,11(4),965-981. |
| MLA | Yong-Chao Li,et al."A Weakly-Supervised Crowd Density Estimation Method Based on Two-Stage Linear Feature Calibration".IEEE/CAA Journal of Automatica Sinica 11.4(2024):965-981. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。