Realizable strategies in continuous-time Markov decision processes

Piunovskiy, AB (2018) Realizable strategies in continuous-time Markov decision processes. SIAM Journal on Control and Optimization, 56 (1). pp. 473-495.

Text SICON2017.pdf - Author Accepted Manuscript Download (230kB)

Abstract

For the Borel model of the continuous-time Markov decision process, we introduce a wide class of control strategies. In a particular case, such strategies transform to the standard relaxed strategies, intensively studied in the last decade. In another special case, if one restricts to another special subclass of the general strategies, the model transforms to the semi-Markov decision process. Further, we show that the relaxed strategies are not realizable. For the constrained optimal control problem with total expected costs, we describe the sufficient class of realizable strategies, the so-called Poisson-related strategies. Finally, we show that, for solving the formulated optimal control problems, one can use all the tools developed earlier for the classical discrete-time Markov decision processes.

Item Type:	Article
Uncontrolled Keywords:	Continuous time Markov decision process, Total cost, Discounted cost, Relaxed strategy, Randomized strategy
Depositing User:	Symplectic Admin
Date Deposited:	18 Jan 2018 11:18
Last Modified:	19 Jan 2023 06:43
DOI:	10.1137/17M1138959
Related URLs:	Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3016349