TURNPIKES IN FINITE MARKOV DECISION PROCESSES AND RANDOM WALK*

Piunovskiy, AB (2023) TURNPIKES IN FINITE MARKOV DECISION PROCESSES AND RANDOM WALK*. THEORY OF PROBABILITY AND ITS APPLICATIONS, 68 (1). pp. 123-149.

Text
TPA2022.pdf - Author Accepted Manuscript
Download (584kB) | Preview

Official URL: http://dx.doi.org/10.1137/s0040585x97t991325

Abstract

In this paper we revise the theory of turnpikes in discounted Markov decision pro-cesses, prove the turnpike theorem for the undiscounted model, and apply the results to the specific random walk.

Item Type:	Article
Uncontrolled Keywords:	Markov decision process, discounted reward, average reward, random walk, stochastic knapsack problem, turnpike
Divisions:	Faculty of Science and Engineering > School of Physical Sciences
Depositing User:	Symplectic Admin
Date Deposited:	16 Jun 2022 07:44
Last Modified:	10 Aug 2023 20:20
DOI:	10.1137/S0040585X97T991325
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3156550