English
Related papers

Related papers: Variational Formulation of Particle Flow

200 papers

The log-homotopy particle flow filter resolves the Bayesian update by transporting particles along a continuous trajectory in pseudo-time. However, the governing partial differential equation for the flow velocity is fundamentally…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Olivér Törő , Domonkos Csuzdi , Tamás Bécsi

Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…

Machine Learning · Statistics 2024-03-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M Stuart

We present a novel approach to approximate Gaussian and mixture-of-Gaussians filtering. Our method relies on a variational approximation via a gradient-flow representation. The gradient flow is derived from a Kullback--Leibler discrepancy…

Computation · Statistics 2023-06-21 Adrien Corenflos , Hany Abdulsamad

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

Optimization and Control · Mathematics 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

Particle flow Gaussian particle flow (PFGPF) uses an invertible particle flow to generate a proposal density. It approximates the predictive and posterior distributions as Gaussian densities. In this paper, we use bank of PFGPF filters to…

Signal Processing · Electrical Eng. & Systems 2023-03-23 Karthik Comandur , Yunpeng Li , Santosh Nannuru

In this paper, we study the stochastic Hamiltonian flow in Wasserstein manifold, the probability density space equipped with $L^2$-Wasserstein metric tensor, via the Wong--Zakai approximation. We begin our investigation by showing that the…

Probability · Mathematics 2021-12-01 Jianbo Cui , Shu Liu , Haomin Zhou

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Recently developed particle flow algorithms provide an alternative to importance sampling for drawing particles from a posterior distribution, and a number of particle filters based on this principle have been proposed. Samples are drawn…

Computation · Statistics 2014-12-01 Pete Bunch , Simon Godsill

We revisit the variational characterization of conservative diffusion as entropic gradient flow and provide for it a probabilistic interpretation based on stochastic calculus. It was shown by Jordan, Kinderlehrer, and Otto that, for…

Probability · Mathematics 2020-08-24 Ioannis Karatzas , Walter Schachermayer , Bertram Tschiderer

State estimation in non-linear models is performed by tracking the posterior distribution recursively. A plethora of algorithms have been proposed for this task. Among them, the Gaussian particle filter uses a weighted set of particles to…

Signal Processing · Electrical Eng. & Systems 2022-07-05 Karthik Comandur , Yunpeng Li , Santosh Nannuru

The recently developed Particle-based Variational Inference (ParVI) methods drive the empirical distribution of a set of \emph{fixed-weight} particles towards a given target distribution $\pi$ by iteratively updating particles' positions.…

Machine Learning · Computer Science 2021-12-03 Chao Zhang , Zhijian Li , Hui Qian , Xin Du

We consider a class of time-homogeneous diffusion processes on $\mathbb{R}^{n}$ with common invariant measure but varying volatility matrices. In Euclidean space, we show via stochastic control of the diffusion coefficient that the…

Probability · Mathematics 2023-10-31 Bertram Tschiderer

Existing deterministic variational inference approaches for diffusion processes use simple proposals and target the marginal density of the posterior. We construct the variational process as a controlled version of the prior process and…

Machine Learning · Computer Science 2021-03-02 Christian Wildner , Heinz Koeppl

We revisit the variational characterization of diffusion as entropic gradient flux and provide for it a probabilistic interpretation based on stochastic calculus. It was shown by Jordan, Kinderlehrer, and Otto that, for diffusions of…

Probability · Mathematics 2020-03-24 Ioannis Karatzas , Walter Schachermayer , Bertram Tschiderer

We consider the motion of a particle governed by a weakly random Hamiltonian flow. We identify temporal and spatial scales on which the particle trajectory converges to a spatial Brownian motion. The main technical issue in the proof is to…

Mathematical Physics · Physics 2009-11-11 T. Komorowski , L. Ryzhik

The method of choice for integrating the time-dependent Fokker-Planck equation in high-dimension is to generate samples from the solution via integration of the associated stochastic differential equation. Here, we study an alternative…

Machine Learning · Computer Science 2023-02-17 Nicholas M. Boffi , Eric Vanden-Eijnden

We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as the limit of…

Machine Learning · Statistics 2018-06-13 Charlie Frogner , Tomaso Poggio

Wasserstein gradient flow has emerged as a promising approach to solve optimization problems over the space of probability distributions. A recent trend is to use the well-known JKO scheme in combination with input convex neural networks to…

Machine Learning · Computer Science 2022-07-26 Jiaojiao Fan , Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

The aim of this paper is to provide a variational interpretation of the nonlinear filter in continuous time. A time-stepping procedure is introduced, consisting of successive minimization problems in the space of probability densities. The…

Optimization and Control · Mathematics 2014-12-19 Richard S. Laugesen , Prashant G. Mehta , Sean P. Meyn , Maxim Raginsky
‹ Prev 1 2 3 10 Next ›