A Novel Resilient Control Scheme for a Class of Markovian Jump Systems With Partially Unknown Information
文献类型：期刊论文
| 作者 | Zhang, Kun1; Su, Rong2; Zhang, Huaguang3,4 |
| 刊名 | IEEE TRANSACTIONS ON CYBERNETICS
 |
| 出版日期 | 2021-02-02 |
| 页码 | 10 |
| 关键词 | Games Process control Markov processes Game theory Actuators System dynamics Heuristic algorithms Adaptive dynamic programming integral reinforcement learning (IRL) resilient control zero-sum game |
| ISSN号 | 2168-2267 |
| DOI | 10.1109/TCYB.2021.3050619 |
| 英文摘要 | In the complex practical engineering systems, many interferences and attacking signals are inevitable in industrial applications. This article investigates the reinforcement learning (RL)-based resilient control algorithm for a class of Markovion jump systems with completely unknown transition probability information. Based on the Takagi-Sugeno logical structure, the resilient control problem of the nonlinear Markovion systems is converted into solving a set of local dynamic games, where the control policy and attacking signal are considered as two rival players. Combining the potential learning and forecasting abilities, the new integral RL (IRL) algorithm is designed via system data to compute the zero-sum games without using the information of stationary transition probability. Besides, the matrices of system dynamics can also be partially unknown, and the new architecture requires less transmission and computation during the learning process. The stochastic stability of the system dynamics under the developed overall resilient control is guaranteed based on the Lyapunov theory. Finally, the designed IRL-based resilient control is applied to a typical multimode robot arm system, and implementing results demonstrate the practicality and effectiveness. |
| 资助项目 | National Postdoctoral Program for Innovative Talents[BX20200357] ; China Postdoctoral Science Foundation[2020M680718] ; Singapore National Research Foundation Delta-NTU Corporate Lab Program[DELTA-NTU CORP-SMA-RP2] ; Singapore Ministry of Education Tier 1 Academic Research[2013-T1002-177] |
| WOS研究方向 | Automation & Control Systems ; Computer Science |
| 语种 | 英语 |
| WOS记录号 | WOS:000732386000001 |
| 出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| 源URL | [http://ir.amss.ac.cn/handle/2S8OKBNM/59721]  |
| 专题 | 中国科学院数学与系统科学研究院 |
| 通讯作者 | Zhang, Kun |
| 作者单位 | 1.Chinese Acad Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China 2.Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore 3.Northeastern Univ, Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China 4.Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110819, Peoples R China |
| 推荐引用方式 GB/T 7714 | Zhang, Kun,Su, Rong,Zhang, Huaguang. A Novel Resilient Control Scheme for a Class of Markovian Jump Systems With Partially Unknown Information[J]. IEEE TRANSACTIONS ON CYBERNETICS,2021:10. |
| APA | Zhang, Kun,Su, Rong,&Zhang, Huaguang.(2021).A Novel Resilient Control Scheme for a Class of Markovian Jump Systems With Partially Unknown Information.IEEE TRANSACTIONS ON CYBERNETICS,10. |
| MLA | Zhang, Kun,et al."A Novel Resilient Control Scheme for a Class of Markovian Jump Systems With Partially Unknown Information".IEEE TRANSACTIONS ON CYBERNETICS (2021):10. |
入库方式： OAI收割
来源：数学与系统科学研究院
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。