Gradual-impulsive control for continuous-time Markov decision processes with total undiscounted costs and constraints: linear programming approach via a reduction method

Piunovskiy, Alexey and Zhang, Yi ORCID: 0000-0002-3200-6306 (2022) Gradual-impulsive control for continuous-time Markov decision processes with total undiscounted costs and constraints: linear programming approach via a reduction method. SIAM Journal on Control and Optimization, 60 (3). pp. 1892-1917.

Text
SICON2022.pdf - Author Accepted Manuscript
Available under License Creative Commons Attribution.
Download (475kB) | Preview

Official URL: http://dx.doi.org/10.1137/21m1444060

Abstract

We consider the constrained optimal control problem for a continuous-time Markov decision process (CTMDP) with gradual-impulsive control. The performance criteria are the expected total undiscounted costs (from the running cost and the impulsive cost). We justify fully a reduction method, and close an open issue in the previous literature. The reduction method induces an equivalent but simpler standard CTMDP model with gradual control only, based on which, we establish effectively, under rather natural conditions, a linear programming approach for solving the concerned constrained optimal control problem.

Item Type:	Article
Uncontrolled Keywords:	continuous-time Markov decision processes, gradual-impulsive control, linear pro-gramming approach, reduction method
Divisions:	Faculty of Science and Engineering > School of Physical Sciences
Depositing User:	Symplectic Admin
Date Deposited:	23 Jun 2022 07:21
Last Modified:	18 Jan 2023 20:57
DOI:	10.1137/21M1444060
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3156994