Regional Multi-Agent Cooperative Reinforcement Learning for City-Level Traffic Grid Signal Control
文献类型：期刊论文
| 作者 | Yisha Li; Ya Zhang; Xinde Li; Changyin Sun |
| 刊名 | IEEE/CAA Journal of Automatica Sinica
 |
| 出版日期 | 2024 |
| 卷号 | 11期号:9页码:1987-1998 |
| 关键词 | Human-machine cooperation mixed domain attention mechanism multi-agent reinforcement learning spatio-temporal feature traffic signal control |
| ISSN号 | 2329-9266 |
| DOI | 10.1109/JAS.2024.124365 |
| 英文摘要 | This article studies the effective traffic signal control problem of multiple intersections in a city-level traffic system. A novel regional multi-agent cooperative reinforcement learning algorithm called RegionSTLight is proposed to improve the traffic efficiency. Firstly a regional multi-agent Q-learning framework is proposed, which can equivalently decompose the global Q value of the traffic system into the local values of several regions. Based on the framework and the idea of human-machine cooperation, a dynamic zoning method is designed to divide the traffic network into several strong-coupled regions according to real-time traffic flow densities. In order to achieve better cooperation inside each region, a lightweight spatio-temporal fusion feature extraction network is designed. The experiments in synthetic, real-world and city-level scenarios show that the proposed RegionSTLight converges more quickly, is more stable, and obtains better asymptotic performance compared to state-of-the-art models. |
| 源URL | [http://ir.ia.ac.cn/handle/173211/58811]  |
| 专题 | 自动化研究所_学术期刊_IEEE/CAA Journal of Automatica Sinica |
| 推荐引用方式 GB/T 7714 | Yisha Li,Ya Zhang,Xinde Li,et al. Regional Multi-Agent Cooperative Reinforcement Learning for City-Level Traffic Grid Signal Control[J]. IEEE/CAA Journal of Automatica Sinica,2024,11(9):1987-1998. |
| APA | Yisha Li,Ya Zhang,Xinde Li,&Changyin Sun.(2024).Regional Multi-Agent Cooperative Reinforcement Learning for City-Level Traffic Grid Signal Control.IEEE/CAA Journal of Automatica Sinica,11(9),1987-1998. |
| MLA | Yisha Li,et al."Regional Multi-Agent Cooperative Reinforcement Learning for City-Level Traffic Grid Signal Control".IEEE/CAA Journal of Automatica Sinica 11.9(2024):1987-1998. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。