Continuous-Time Distributed Policy Iteration for Multicontroller Nonlinear Systems
文献类型:期刊论文
作者 | Wei, Qinglai1,2,3![]() ![]() ![]() |
刊名 | IEEE TRANSACTIONS ON CYBERNETICS
![]() |
出版日期 | 2021-05-01 |
卷号 | 51期号:5页码:2372-2383 |
关键词 | Optimal control Nonlinear systems Decentralized control Mathematical model Convergence Multi-agent systems Adaptive dynamic programming (ADP) approximate dynamic programming distributed policy iteration nonlinear systems optimal control |
ISSN号 | 2168-2267 |
DOI | 10.1109/TCYB.2020.2979614 |
通讯作者 | Wei, Qinglai(qinglai.wei@ia.ac.cn) |
英文摘要 | In this article, a novel distributed policy iteration algorithm is established for infinite horizon optimal control problems of continuous-time nonlinear systems. In each iteration of the developed distributed policy iteration algorithm, only one controller's control law is updated and the other controllers' control laws remain unchanged. The main contribution of the present algorithm is to improve the iterative control law one by one, instead of updating all the control laws in each iteration of the traditional policy iteration algorithms, which effectively releases the computational burden in each iteration. The properties of distributed policy iteration algorithm for continuous-time nonlinear systems are analyzed. The admissibility of the present methods has also been analyzed. Monotonicity, convergence, and optimality have been discussed, which show that the iterative value function is nonincreasingly convergent to the solution of the Hamilton-Jacobi-Bellman equation. Finally, numerical simulations are conducted to illustrate the effectiveness of the proposed method. |
WOS关键词 | ZERO-SUM GAMES ; MULTIAGENT SYSTEMS ; TRACKING CONTROL ; DRIVEN |
资助项目 | National Natural Science Foundation of China[61722312] ; National Science Foundation[ECCS 1917275] |
WOS研究方向 | Automation & Control Systems ; Computer Science |
语种 | 英语 |
WOS记录号 | WOS:000641968100007 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
资助机构 | National Natural Science Foundation of China ; National Science Foundation |
源URL | [http://ir.ia.ac.cn/handle/173211/44545] ![]() |
专题 | 自动化研究所_复杂系统管理与控制国家重点实验室_智能化团队 |
通讯作者 | Wei, Qinglai |
作者单位 | 1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China 3.Qingdao Acad Intelligent Ind, Qingdao 266109, Peoples R China 4.Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China 5.Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA |
推荐引用方式 GB/T 7714 | Wei, Qinglai,Li, Hongyang,Yang, Xiong,et al. Continuous-Time Distributed Policy Iteration for Multicontroller Nonlinear Systems[J]. IEEE TRANSACTIONS ON CYBERNETICS,2021,51(5):2372-2383. |
APA | Wei, Qinglai,Li, Hongyang,Yang, Xiong,&He, Haibo.(2021).Continuous-Time Distributed Policy Iteration for Multicontroller Nonlinear Systems.IEEE TRANSACTIONS ON CYBERNETICS,51(5),2372-2383. |
MLA | Wei, Qinglai,et al."Continuous-Time Distributed Policy Iteration for Multicontroller Nonlinear Systems".IEEE TRANSACTIONS ON CYBERNETICS 51.5(2021):2372-2383. |
入库方式: OAI收割
来源:自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。