Efficient Learning of the Parameters of Non-Linear Models using Differentiable Resampling in Particle Filters



Maskell, simon ORCID: 0000-0003-1917-2913, Devlin, lee ORCID: 0000-0002-2059-7284, Beraud, vincent, Horridge, paul and Rosato, Conor ORCID: 0000-0001-8394-7344
(2022) Efficient Learning of the Parameters of Non-Linear Models using Differentiable Resampling in Particle Filters. IEEE Transactions on Signal Processing, 70. pp. 3676-3692.

[img] Text
Particle_NUTS_new (4).pdf - Author Accepted Manuscript

Download (5MB) | Preview

Abstract

It has been widelydocumented that the sampling and resampling steps in particle filters cannot be differentiated. The reparameterisation trick was introduced to allow the sampling step to be reformulated into a differentiable function. We extend the reparameterisation trick to include the stochastic input to resampling therefore limiting the discontinuities in the gradient calculation after this step. Knowing the gradients of the prior and likelihood allows us to run particle Markov Chain Monte Carlo (p-MCMC) and use the No-U-Turn Sampler (NUTS) as the proposal when estimating parameters. We compare the Metropolis-adjusted Langevin algorithm (MALA), Hamiltonian Monte Carlo with different number of steps and NUTS. We consider three state-space models and show that NUTS improves the mixing of the Markov chain and can produce more accurate results in less computational time.

Item Type: Article
Uncontrolled Keywords: Bayesian analysis, No-U-Turn Sampler, particle-MCMC, reparameterisation trick, state-space models
Divisions: Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User: Symplectic Admin
Date Deposited: 30 Jun 2022 14:51
Last Modified: 15 Mar 2024 08:52
DOI: 10.1109/TSP.2022.3187868
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3157473