中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A note on optimality conditions for continuous-time Markov decision processes with average cost criterion

文献类型:期刊论文

作者Guo, XP; Liu, K
刊名IEEE TRANSACTIONS ON AUTOMATIC CONTROL
出版日期2001-12-01
卷号46期号:12页码:1984-1989
ISSN号0018-9286
关键词average cost criterion continuous-time Markov decision processes (MDPs) optimal stationary policies optimality inequality
英文摘要This note deals with continuous-time Markov decision processes with a denumerable state space and the average cost criterion. The transition rates are allowed to be unbounded, and the action set is a Borel space. We give a new set of conditions under which the existence of optimal stationary policies is ensured by using the optimality inequality. Our results are illustrated with a controlled queueing model. Moreover, we use an example to show that our conditions do not imply the existence of a solution to the optimality equations in the previous literature.
WOS研究方向Automation & Control Systems ; Engineering
语种英语
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号WOS:000173370600021
源URL[http://ir.amss.ac.cn/handle/2S8OKBNM/15829]  
专题应用数学研究所
通讯作者Guo, XP
作者单位1.Zhongshan Univ, Dept Math, Guangzhou, Peoples R China
2.Asia Pacific Operat Res Ctr, Seoul, South Korea
3.Chinese Acad Sci, Acad Math & Syst Sci, Inst Appl Math, Beijing 100864, Peoples R China
推荐引用方式
GB/T 7714
Guo, XP,Liu, K. A note on optimality conditions for continuous-time Markov decision processes with average cost criterion[J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL,2001,46(12):1984-1989.
APA Guo, XP,&Liu, K.(2001).A note on optimality conditions for continuous-time Markov decision processes with average cost criterion.IEEE TRANSACTIONS ON AUTOMATIC CONTROL,46(12),1984-1989.
MLA Guo, XP,et al."A note on optimality conditions for continuous-time Markov decision processes with average cost criterion".IEEE TRANSACTIONS ON AUTOMATIC CONTROL 46.12(2001):1984-1989.

入库方式: OAI收割

来源:数学与系统科学研究院

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。