中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Quantum-enhanced reinforcement learning for control: a preliminary study

文献类型:期刊论文

作者Hu YZ(胡亚洲)2; Tang FZ(唐凤珍)1,3; Chen, Jun2; Wang WX(王文学)1,3
刊名Control Theory and Technology
出版日期2021
卷号19期号:4页码:455-464
关键词Quantum theory Reinforcement learning Quantum computation State superposition Optimal control
ISSN号2095-6983
产权排序2
英文摘要

Reinforcement learning is one of the fastest growing areas in machine learning, and has obtained great achievements in biomedicine, Internet of Things (IoT), logistics, robotic control, etc. However, there are still many challenges for engineering applications, such as how to speed up the learning process, how to balance the trade-off between exploration and exploitation. Quantum technology, which can solve complex problems faster than classical methods, especially in supercomputers, provides us a new paradigm to overcome these challenges in reinforcement learning. In this paper, a quantum-enhanced reinforcement learning is pictured for optimal control. In this algorithm, the states and actions of reinforcement learning are quantized by quantum technology. And then, a probability amplification method, which can effectively avoid the trade-off between exploration and exploitation via quantized technology, is presented. Finally, the optimal control policy is learnt during the process of reinforcement learning. The performance of this quantized algorithm is demonstrated in both MountainCar reinforcement learning environment and CartPole reinforcement learning environment—one kind of classical control reinforcement learning environment in the OpenAI Gym. The preliminary study results validate that, compared with Q-learning, this quantized reinforcement learning method has better control performance without considering the trade-off between exploration and exploitation. The learning performance of this new algorithm is stable with different learning rates from 0.01 to 0.10, which means it is promising to be employed in unknown dynamics systems.

语种英语
CSCD记录号CSCD:7126674
源URL[http://ir.sia.cn/handle/173321/30086]  
专题沈阳自动化研究所_机器人学研究室
通讯作者Wang WX(王文学)
作者单位1.Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang, Liaoning 110169, China
2.College of Mechanical and Electronic Engineering, Northwest A& F University, Yangling, Shaanxi 712100, China
3.The State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, Liaoning 110016, China
推荐引用方式
GB/T 7714
Hu YZ,Tang FZ,Chen, Jun,et al. Quantum-enhanced reinforcement learning for control: a preliminary study[J]. Control Theory and Technology,2021,19(4):455-464.
APA Hu YZ,Tang FZ,Chen, Jun,&Wang WX.(2021).Quantum-enhanced reinforcement learning for control: a preliminary study.Control Theory and Technology,19(4),455-464.
MLA Hu YZ,et al."Quantum-enhanced reinforcement learning for control: a preliminary study".Control Theory and Technology 19.4(2021):455-464.

入库方式: OAI收割

来源:沈阳自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。