Using Transfer Learning to Model Unknown Opponents in Automated Negotiations



Chen, Siqi, Zhou, Shuang, Weiss, Gerhard and Tuyls, Karl
(2016) Using Transfer Learning to Model Unknown Opponents in Automated Negotiations. .

[thumbnail of ACAN2014_revised_prepub_final.pdf] Text
ACAN2014_revised_prepub_final.pdf - Unspecified

Download (123kB)

Abstract

Modeling unknown opponents is known as a key factor for the efficiency of automated negotiations. The learning processes are however challenging because of (1) the indirect way the target function can be observed, and (2) the limited amount of experience available to learn from an unknown opponent at a single session. To address these difficulties we propose to adopt two approaches from transfer learning. Both approaches transfer knowledge from previous tasks to the current negotiation of an agent to aid learn the latent behavior model of an opposing agent. The first approach achieves knowledge transfer by weighting the encounter offers of previous tasks and the ongoing task, while the second one by weighting the models learnt from the previous negotiation tasks and the model learnt from the current negotiation session. Extensive experimental results show the applicability and effectiveness of both approaches. Moreover, the robustness of the proposed approaches is evaluated using empirical game theoretic analysis.

Item Type: Conference or Workshop Item (Unspecified)
Uncontrolled Keywords: 46 Information and Computing Sciences, 4602 Artificial Intelligence
Depositing User: Symplectic Admin
Date Deposited: 26 May 2016 09:26
Last Modified: 22 Jun 2024 03:18
DOI: 10.1007/978-3-319-30307-9_11
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3001370