English
Related papers

Related papers: Differentiable Interacting Multiple Model Particle…

200 papers

Interacting particle systems play a key role in science and engineering. Access to the governing particle interaction law is fundamental for a complete understanding of such systems. However, the inherent system complexity keeps the…

Machine Learning · Computer Science 2022-10-25 Zhichao Han , David S. Kammer , Olga Fink

Differentiable programming is the combination of classical neural networks modules with algorithmic ones in an end-to-end differentiable model. These new models, that use automatic differentiation to calculate gradients, have new learning…

Dynamical Systems · Mathematics 2020-05-05 Adrián Hernández , José M. Amigó

Particle filters provide Monte Carlo approximations of intractable quantities such as point-wise evaluations of the likelihood in state space models. In many scenarios, the interest lies in the comparison of these quantities as some…

Methodology · Statistics 2016-07-19 Pierre E. Jacob , Fredrik Lindsten , Thomas B. Schön

We present differentiable particle filters (DPFs): a differentiable implementation of the particle filter algorithm with learnable motion and measurement models. Since DPFs are end-to-end differentiable, we can efficiently train their…

Machine Learning · Computer Science 2018-05-31 Rico Jonschkowski , Divyam Rastogi , Oliver Brock

The performance of data fusion and tracking algorithms often depends on parameters that not only describe the sensor system, but can also be task-specific. While for the sensor system tuning these variables is time-consuming and mostly…

Machine Learning · Computer Science 2024-01-29 André Brandenburger , Folker Hoffmann , Alexander Charlish

Sequential learning in deep models often suffers from challenges such as catastrophic forgetting and loss of plasticity, largely due to the permutation dependence of gradient-based algorithms, where the order of training data impacts the…

Machine Learning · Computer Science 2024-10-31 Akhilan Boopathy , Aneesh Muppidi , Peggy Yang , Abhiram Iyer , William Yue , Ila Fiete

We propose a hierarchy of multi-level kinetic Monte Carlo methods for sampling high-dimensional, stochastic lattice particle dynamics with complex interactions. The method is based on the efficient coupling of different spatial resolution…

Numerical Analysis · Mathematics 2012-08-06 Evangelia Kalligiannaki , Markos A. Katsoulakis , Petr Plechac

Differentiable particle filters combine the flexibility of neural networks with the probabilistic nature of sequential Monte Carlo methods. However, traditional approaches rely on the availability of labelled data, i.e., the ground truth…

Machine Learning · Computer Science 2024-05-03 Jiaxi Li , John-Joseph Brady , Xiongjie Chen , Yunpeng Li

It has been widely documented that the sampling and resampling steps in particle filters cannot be differentiated. The {\itshape reparameterisation trick} was introduced to allow the sampling step to be reformulated into a differentiable…

Machine Learning · Statistics 2022-08-10 Conor Rosato , Vincent Beraud , Paul Horridge , Thomas B. Schön , Simon Maskell

Sequential Monte Carlo techniques are useful for state estimation in non-linear, non-Gaussian dynamic models. These methods allow us to approximate the joint posterior distribution using sequential importance sampling. In this framework,…

Computation · Statistics 2012-07-09 Mike Klaas , Nando de Freitas , Arnaud Doucet

Probabilistic (or Bayesian) modeling and learning offers interesting possibilities for systematic representation of uncertainty using probability theory. However, probabilistic learning often leads to computationally challenging problems.…

Computation · Statistics 2018-03-14 Andreas Svensson , Thomas B. Schön , Fredrik Lindsten

Automatic differentiation (AD) has driven recent advances in machine learning, including deep neural networks and Hamiltonian Markov Chain Monte Carlo methods. Partially observed nonlinear stochastic dynamical systems have proved resistant…

Methodology · Statistics 2024-07-04 Kevin Tan , Giles Hooker , Edward L. Ionides

In this paper we combine the non-linear filtering capabilities of particle filters with the transdimensional inference of the reversible-jump Markov chain Monte Carlo method for a data assimilation methodology over dynamic problems with…

Geophysics · Physics 2026-03-27 Márk Somogyvári , Sebastian Reich

Resampling is a key component of sample-based recursive state estimation in particle filters. Recent work explores differentiable particle filters for end-to-end learning. However, resampling remains a challenge in these works, as it is…

Machine Learning · Computer Science 2020-04-28 Michael Zhu , Kevin Murphy , Rico Jonschkowski

Most stochastic gradient descent algorithms can optimize neural networks that are sub-differentiable in their parameters; however, this implies that the neural network's activation function must exhibit a degree of continuity which limits…

Neural and Evolutionary Computing · Computer Science 2021-12-16 Anastasis Kratsios , Behnoosh Zamanlooy

Multi-object state estimation is a fundamental problem for robotic applications where a robot must interact with other moving objects. Typically, other objects' relevant state features are not directly observable, and must instead be…

Robotics · Computer Science 2022-12-15 Angad Singh , Omar Makhlouf , Maximilian Igl , Joao Messias , Arnaud Doucet , Shimon Whiteson

We consider the problem of simultaneous control and parameter estimation when the model is available only as a differentiable physics simulator. We propose a receding-horizon control framework in which a model predictive control (MPC)…

Optimization and Control · Mathematics 2026-04-07 Alan Williams , Alp Sunol

Sequential Monte Carlo methods, also known as particle methods, are a widely used set of computational tools for inference in non-linear non-Gaussian state-space models. In many applications it may be necessary to compute the sensitivity,…

Statistics Theory · Mathematics 2011-06-14 Pierre Del Moral , Arnaud Doucet , Sumeetpal Singh

When modeling longitudinal biomedical data, often dimensionality reduction as well as dynamic modeling in the resulting latent representation is needed. This can be achieved by artificial neural networks for dimension reduction, and…

Machine Learning · Statistics 2023-12-01 Göran Köber , Raffael Kalisch , Lara Puhlmann , Andrea Chmitorz , Anita Schick , Harald Binder

We propose a divide-and-conquer approach to filtering which decomposes the state variable into low-dimensional components to which standard particle filtering tools can be successfully applied and recursively merges them to recover the full…

Methodology · Statistics 2022-11-28 Francesca R. Crucinio , Adam M. Johansen