Policy Space Response Oracles: A Survey

Bighashdel, A, Wang, Y, McAleer, S, Savani, R ORCID: 0000-0003-1262-7831 and Oliehoek, FA (2024) Policy Space Response Oracles: A Survey In: Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence, 2023-8-19 - 2023-8-25.

Text ijcai24.pdf - Author Accepted Manuscript Available under License Creative Commons Attribution. Download (286kB) | Preview

Abstract

Game theory provides a mathematical way to study the interaction between multiple decision makers. However, classical game-theoretic analysis is limited in scalability due to the large number of strategies, precluding direct application to more complex scenarios. This survey provides a comprehensive overview of a framework for large games, known as Policy Space Response Oracles (PSRO), which holds promise to improve scalability by focusing attention on sufficient subsets of strategies. We first motivate PSRO and provide historical context. We then focus on the strategy exploration problem for PSRO: the challenge of assembling effective subsets of strategies that still represent the original game well with minimum computational cost. We survey current research directions for enhancing the efficiency of PSRO, and explore the applications of PSRO across various domains. We conclude by discussing open questions and future research.

Item Type:	Conference Item (Unspecified)
Uncontrolled Keywords:	46 Information and Computing Sciences, 4608 Human-Centred Computing, Machine Learning and Artificial Intelligence, Generic health relevance
Divisions:	Faculty of Science & Engineering Faculty of Science & Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User:	Symplectic Admin
Date Deposited:	22 Nov 2024 10:16
Last Modified:	23 May 2026 09:11
DOI:	10.24963/ijcai.2024/880
Related Websites:	Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3188064
Disclaimer:	The University of Liverpool is not responsible for content contained on other websites from links within repository metadata. Please contact us if you notice anything that appears incorrect or inappropriate.