Online approximate optimal control for affine non-linear systems with unknown internal dynamics using adaptive dynamic programming
文献类型：期刊论文
| 作者 | Yang, Xiong ; Liu, Derong; Wei, Qinglai
|
| 刊名 | IET CONTROL THEORY AND APPLICATIONS
 |
| 出版日期 | 2014-11-06 |
| 卷号 | 8期号:16页码:1676-1688 |
| 英文摘要 | In this study, a novel online adaptive dynamic programming (ADP)-based algorithm is developed for solving the optimal control problem of affine non-linear continuous-time systems with unknown internal dynamics. The present algorithm employs an observer-critic architecture to approximate the Hamilton-Jacobi-Bellman equation. Two neural networks (NNs) are used in this architecture: an NN state observer is constructed to estimate the unknown system dynamics and a critic NN is designed to derive the optimal control instead of typical action-critic dual networks employed in traditional ADP algorithms. Based on the developed architecture, the observer NN and the critic NN are tuned simultaneously. Meanwhile, unlike existing tuning laws for the critic, the newly developed critic update rule not only ensures convergence of the critic to the optimal control but also guarantees stability of the closed-loop system. No initial stabilising control is required, and by using recorded and instantaneous data simultaneously for the adaptation of the critic, the restrictive persistence of excitation condition is relaxed. In addition, Lyapunov direct method is utilised to demonstrate the uniform ultimate boundedness of the weights of the observer NN and the critic NN. Finally, an example is provided to verify the effectiveness of the present approach. |
| WOS标题词 | Science & Technology ; Technology |
| 类目[WOS] | Automation & Control Systems ; Engineering, Electrical & Electronic ; Instruments & Instrumentation |
| 研究领域[WOS] | Automation & Control Systems ; Engineering ; Instruments & Instrumentation |
| 关键词[WOS] | LEARNING CONTROL ; CONTROL SCHEME ; REINFORCEMENT ; ARCHITECTURE ; ALGORITHM ; NETWORKS ; EQUATION ; DESIGN |
| 收录类别 | SCI |
| 语种 | 英语 |
| WOS记录号 | WOS:000344554800008 |
| 源URL | [http://ir.ia.ac.cn/handle/173211/3847]  |
| 专题 | 自动化研究所_复杂系统管理与控制国家重点实验室_智能化团队 |
| 作者单位 | Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China |
| 推荐引用方式 GB/T 7714 | Yang, Xiong,Liu, Derong,Wei, Qinglai. Online approximate optimal control for affine non-linear systems with unknown internal dynamics using adaptive dynamic programming[J]. IET CONTROL THEORY AND APPLICATIONS,2014,8(16):1676-1688. |
| APA | Yang, Xiong,Liu, Derong,&Wei, Qinglai.(2014).Online approximate optimal control for affine non-linear systems with unknown internal dynamics using adaptive dynamic programming.IET CONTROL THEORY AND APPLICATIONS,8(16),1676-1688. |
| MLA | Yang, Xiong,et al."Online approximate optimal control for affine non-linear systems with unknown internal dynamics using adaptive dynamic programming".IET CONTROL THEORY AND APPLICATIONS 8.16(2014):1676-1688. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。