A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space
文献类型：期刊论文
| 作者 | Y. Gao; Y. Wang; L. Zhang; L. Guo; J. Li and S. Sun |
| 刊名 | IEEE Access
 |
| 出版日期 | 2023 |
| 卷号 | 11页码:107669-107684 |
| ISSN号 | 21693536 |
| DOI | 10.1109/ACCESS.2023.3320137 |
| 英文摘要 | It is the key research object of electronic warfare to use UAV (Unmanned Aerial Vehicle) clusters to carry out electronic countermeasure tasks. The UAV carries loads such as reconnaissance and interference at the same time, which makes it necessary to simultaneously decide multiple types of actions - namely, compound actions - which poses a challenge to intelligent decision-making algorithms. Considering the problem of action-space dimensional complexity and weak collaboration between decisions in multi-agent scenarios with composite actions, this study proposed a decision algorithm involving a multi-agent reinforcement-learning sequence, which combined joint composite actions into sequential decision, reducing the difficulty of a single decision and enhancing the collaboration between various agents and their individual decisions. Because long decision sequences required better depth modeling and had high variance, a DeLighT module was added to the naïve transformer model to increase the depth and baseline techniques, which were used to reduce the variance in the value estimation. The simulated results verified the effectiveness of the proposed algorithm in the UAV cooperative combat scenario, where each agent had a composite action space and showed better performance than the existing algorithms. © 2013 IEEE. |
| URL标识 | 查看原文 |
| 源URL | [http://ir.ciomp.ac.cn/handle/181722/67478]  |
| 专题 | 中国科学院长春光学精密机械与物理研究所 |
| 推荐引用方式 GB/T 7714 | Y. Gao,Y. Wang,L. Zhang,et al. A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space[J]. IEEE Access,2023,11:107669-107684. |
| APA | Y. Gao,Y. Wang,L. Zhang,L. Guo,&J. Li and S. Sun.(2023).A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space.IEEE Access,11,107669-107684. |
| MLA | Y. Gao,et al."A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space".IEEE Access 11(2023):107669-107684. |
入库方式： OAI收割
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。