Constrained Continuous-Time Markov Decision Processes on the Finite Horizon



Guo, Xianping, Huang, Yonghui and Zhang, Yi ORCID: 0000-0002-3200-6306
(2017) Constrained Continuous-Time Markov Decision Processes on the Finite Horizon. APPLIED MATHEMATICS AND OPTIMIZATION, 75 (2). pp. 317-341.

[img] Text
GuoHuangZhang2015R2AA.pdf - Author Accepted Manuscript

Download (151kB)

Abstract

This paper studies the constrained (nonhomogeneous) continuous-time Markov decision processes on the finite horizon. The performance criterion to be optimized is the expected total reward on the finite horizon, while N constraints are imposed on similar expected costs. Introducing the appropriate notion of the occupation measures for the concerned optimal control problem, we establish the following under some suitable conditions: (a) the class of Markov policies is sufficient; (b) every extreme point of the space of performance vectors is generated by a deterministic Markov policy; and (c) there exists an optimal Markov policy, which is a mixture of no more than N+ 1 deterministic Markov policies.

Item Type: Article
Uncontrolled Keywords: Continuous-time Markov decision process, Constrained-optimality, Finite horizon, Mixture of N+1 deterministic Markov policies, Occupation measure
Depositing User: Symplectic Admin
Date Deposited: 04 Jul 2016 10:58
Last Modified: 19 Jan 2023 07:35
DOI: 10.1007/s00245-016-9352-6
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3001778