Maximizing the Probability of Arriving on Time: A Practical Q-Learning Method



Cao, Zhiguang, Guo, Hongliang, Zhang, Jie, Oliehoek, Frans ORCID: 0000-0003-4372-5055 and Fastenrath, Ulrich
(2017) Maximizing the Probability of Arriving on Time: A Practical Q-Learning Method. In: Thirty-First AAAI Conference on Artificial Intelligence (AAAI), 2017-2-4 - 2017-2-9, San Fransisco.

[img] Text
Cao17AAAI.pdf - Author Accepted Manuscript

Download (333kB)

Abstract

<jats:p> The stochastic shortest path problem is of crucial importance for the development of sustainable transportation systems. Existing methods based on the probability tail model seek for the path that maximizes the probability of arriving at the destination before a deadline. However, they suffer from low accuracy and/or high computational cost. We design a novel Q-learning method where the converged Q-values have the practical meaning as the actual probabilities of arriving on time so as to improve accuracy. By further adopting dynamic neural networks to learn the value function, our method can scale well to large road networks with arbitrary deadlines. Experimental results on real road networks demonstrate the significant advantages of our method over other counterparts. </jats:p>

Item Type: Conference or Workshop Item (Unspecified)
Uncontrolled Keywords: Behavioral and Social Science, Basic Behavioral and Social Science
Depositing User: Symplectic Admin
Date Deposited: 10 Jan 2017 11:40
Last Modified: 24 Mar 2024 19:37
DOI: 10.1609/aaai.v31i1.11170
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3005096