Bidding Games on Markov Decision Processes

Avni, Guy, Henzinger, Thomas A, Ibsen-Jensen, Rasmus ORCID: 0000-0003-4783-0389 and Novotný, Petr (2019) Bidding Games on Markov Decision Processes. .

Text invited_paper_2.pdf - Author Accepted Manuscript Download (436kB) | Preview

Abstract

In two-player games on graphs, the players move a token through a graph to produce an infinite path, which determines the qualitative winner or quantitative payoff of the game. In bidding games, in each turn, we hold an auction between the two players to determine which player moves the token. Bidding games have largely been studied with concrete bidding mechanisms that are variants of a first-price auction: in each turn both players simultaneously submit bids, the higher bidder moves the token, and pays his bid to the lower bidder in Richman bidding, to the bank in poorman bidding, and in taxman bidding, the bid is split between the other player and the bank according to a predefined constant factor. Bidding games are deterministic games. They have an intriguing connection with a fragment of stochastic games called random-turn games. We study, for the first time, a combination of bidding games with probabilistic behavior; namely, we study bidding games that are played on Markov decision processes, where the players bid for the right to choose the next action, which determines the probability distribution according to which the next vertex is chosen. We study parity and mean-payoff bidding games on MDPs and extend results from the deterministic bidding setting to the probabilistic one.

Item Type:	Conference or Workshop Item (Unspecified)
Depositing User:	Symplectic Admin
Date Deposited:	16 Oct 2019 13:17
Last Modified:	22 Nov 2023 23:23
DOI:	10.1007/978-3-030-30806-3_1
Related URLs:	Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3058382