Using Transfer Learning to Model Unknown Opponents in Automated Negotiations

Chen, Siqi, Zhou, Shuang, Weiss, Gerhard and Tuyls, Karl (2016) Using Transfer Learning to Model Unknown Opponents in Automated Negotiations. .

Text ACAN2014_revised_prepub_final.pdf - Unspecified Download (123kB)

Abstract

Modeling unknown opponents is known as a key factor for the efficiency of automated negotiations. The learning processes are however challenging because of (1) the indirect way the target function can be observed, and (2) the limited amount of experience available to learn from an unknown opponent at a single session. To address these difficulties we propose to adopt two approaches from transfer learning. Both approaches transfer knowledge from previous tasks to the current negotiation of an agent to aid learn the latent behavior model of an opposing agent. The first approach achieves knowledge transfer by weighting the encounter offers of previous tasks and the ongoing task, while the second one by weighting the models learnt from the previous negotiation tasks and the model learnt from the current negotiation session. Extensive experimental results show the applicability and effectiveness of both approaches. Moreover, the robustness of the proposed approaches is evaluated using empirical game theoretic analysis.

Item Type:	Conference or Workshop Item (Unspecified)
Depositing User:	Symplectic Admin
Date Deposited:	26 May 2016 09:26
Last Modified:	19 Jan 2023 07:36
DOI:	10.1007/978-3-319-30307-9_11
Related URLs:	Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3001370