English
Related papers

Related papers: Variational Gaussian filtering via Wasserstein gra…

200 papers

The Bayesian smoothing equations are generally intractable for systems described by nonlinear stochastic differential equations and discrete-time measurements. Gaussian approximations are a computationally efficient way to approximate the…

Dynamical Systems · Mathematics 2016-04-05 Juha Ala-Luhtala , Simo Särkkä , Robert Piché

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard problem from a…

Statistics Theory · Mathematics 2023-01-05 Yuling Yan , Kaizheng Wang , Philippe Rigollet

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

In estimation theory, the Kushner equation provides the evolution of the probability density of the state of a dynamical system given continuous-time observations. Building upon our recent work, we propose a new way to approximate the…

Machine Learning · Statistics 2023-10-04 Marc Lambert , Silvère Bonnabel , Francis Bach

Variational inference is a technique that approximates a target distribution by optimizing within the parameter space of variational families. On the other hand, Wasserstein gradient flows describe optimization within the space of…

Machine Learning · Statistics 2023-11-01 Mingxuan Yi , Song Liu

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Variational inference, such as the mean-field (MF) approximation, requires certain conjugacy structures for efficient computation. These can impose unnecessary restrictions on the viable prior distribution family and further constraints on…

Statistics Theory · Mathematics 2023-09-11 Rentian Yao , Yun Yang

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

Optimization and Control · Mathematics 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

Gaussian mixture filters for nonlinear systems usually rely on severe approximations when calculating mixtures in the prediction and filtering step. Thus, offline approximations of noise densities by Gaussian mixture densities to reduce the…

Systems and Control · Electrical Eng. & Systems 2025-06-02 Ondŕej Straka , Uwe D. Hanebeck

This paper uses sample data to study the problem of comparing populations on finite-dimensional parallelizable Riemannian manifolds and more general trivial vector bundles. Utilizing triviality, our framework represents populations as…

Methodology · Statistics 2023-11-29 Michael Wilson , Tom Needham , Chiwoo Park , Suprateek Kundu , Anuj Srivastava

Gaussian mixtures are a common density representation in nonlinear, non-Gaussian Bayesian state estimation. Selecting an appropriate number of Gaussian components, however, is difficult as one has to trade of computational complexity…

Systems and Control · Computer Science 2012-04-02 Marco F. Huber

This work addresses the problem of state estimation in multivariable dynamic systems with quantized outputs, a common scenario in applications involving low-resolution sensors or communication constraints. A novel method is proposed to…

Systems and Control · Electrical Eng. & Systems 2025-09-10 Angel L. Cedeño , Rodrigo A. González , Boris I. Godoy , Juan C. Agüero

This paper is considered with joint estimation of state and time-varying noise covariance matrices in non-linear stochastic state space models. We present a variational Bayes and Gaussian filtering based algorithm for efficient computation…

Methodology · Statistics 2013-02-05 Simo Särkkä Jouni Hartikainen

Wasserstein gradient flow has emerged as a promising approach to solve optimization problems over the space of probability distributions. A recent trend is to use the well-known JKO scheme in combination with input convex neural networks to…

Machine Learning · Computer Science 2022-07-26 Jiaojiao Fan , Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as the limit of…

Machine Learning · Statistics 2018-06-13 Charlie Frogner , Tomaso Poggio

Gradient flow in the 2-Wasserstein space is widely used to optimize functionals over probability distributions and is typically implemented using an interacting particle system with $n$ particles. Analyzing these algorithms requires showing…

Machine Learning · Computer Science 2026-03-27 Chandan Tankala , Dheeraj M. Nagaraj , Anant Raj

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

Stochastic filtering is defined as the estimation of a partially observed dynamical system. A massive scientific and computational effort is dedicated to the development of numerical methods for approximating the solution of the filtering…

Probability · Mathematics 2013-06-04 Dan Crisan , Kai Li

In inverse problems, many conditional generative models approximate the posterior measure by minimizing a distance between the joint measure and its learned approximation. While this approach also controls the distance between the posterior…

Machine Learning · Computer Science 2025-08-28 Jannis Chemseddine , Paul Hagemann , Gabriele Steidl , Christian Wald

Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…

Machine Learning · Statistics 2024-03-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M Stuart
‹ Prev 1 2 3 10 Next ›