Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning
文献类型：期刊论文
| 作者 | Yang, Xiong3 ; Xu, Mengmeng3; Wei, Qinglai1,2
|
| 刊名 | IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
 |
| 出版日期 | 2022-06-06 |
| 页码 | 15 |
| ISSN号 | 2162-237X |
| 关键词 | Asymptotic stability Interconnected systems Decentralized control Closed loop systems Artificial neural networks Optimal control Nonlinear dynamical systems Adaptive dynamic programming (ADP) decentralized control event-based control interconnected system reinforcement learning (RL) |
| DOI | 10.1109/TNNLS.2022.3178017 |
| 通讯作者 | Yang, Xiong(xiong.yang@tju.edu.cn) |
| 英文摘要 | We develop a decentralized dynamic event-based control strategy for nonlinear systems subject to matched interconnections. To begin with, we introduce a dynamic event-based sampling mechanism, which relies on the system's states and the variables generated by time-based differential equations. Then, we prove that the decentralized event-based controller for the whole system is composed of all the optimal event-based control policies of nominal subsystems. To derive these optimal event-based control policies, we design a critic-only architecture to solve the related event-based Hamilton-Jacobi-Bellman equations in the reinforcement learning framework. The implementation of such an architecture uses only critic neural networks (NNs) with their weight vectors being updated through the gradient descent method together with concurrent learning. After that, we demonstrate that the asymptotic stability of closed-loop nominal subsystems and the uniformly ultimate boundedness stability of critic NNs' weight estimation errors are guaranteed by using Lyapunov's approach. Finally, we provide simulations of a matched nonlinear-interconnected plant to validate the present theoretical claims. |
| WOS关键词 | DECENTRALIZED CONTROL |
| 资助项目 | National Natural Science Foundation of China[61973228] |
| WOS研究方向 | Computer Science ; Engineering |
| 语种 | 英语 |
| 出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| WOS记录号 | WOS:000809370200001 |
| 资助机构 | National Natural Science Foundation of China |
| 源URL | [http://ir.ia.ac.cn/handle/173211/49638]  |
| 专题 | 自动化研究所_复杂系统管理与控制国家重点实验室_智能化团队 |
| 通讯作者 | Yang, Xiong |
| 作者单位 | 1.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China 2.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 3.Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China |
| 推荐引用方式 GB/T 7714 | Yang, Xiong,Xu, Mengmeng,Wei, Qinglai. Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2022:15. |
| APA | Yang, Xiong,Xu, Mengmeng,&Wei, Qinglai.(2022).Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,15. |
| MLA | Yang, Xiong,et al."Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022):15. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。