English
Related papers

Related papers: Variational Gaussian approximation of the Kushner …

200 papers

Given a determinate (multivariate) probability measure $\mu$, we characterize Gaussian mixtures $\nu\_\phi$ which minimize the Wasserstein distance $W\_2(\mu,\nu\_\phi)$ to $\mu$ when the mixing probability measure $\phi$ on the parameters…

Optimization and Control · Mathematics 2024-05-01 Jean-Bernard Lasserre

Bayesian filtering is a cornerstone of state estimation in complex systems such as aerospace systems, yet exact solutions are available only for linear Gaussian models. In practice,nonlinear systems are handled through tractable…

Variational Optimization forms a differentiable upper bound on an objective. We show that approaches such as Natural Evolution Strategies and Gaussian Perturbation, are special cases of Variational Optimization in which the expectations are…

Machine Learning · Statistics 2018-09-14 Thomas Bird , Julius Kunze , David Barber

This paper contributes to the emerging viewpoint that governing equations for dynamic state estimation, conditioned on the history of noisy measurements, can be viewed as gradient flow on the manifold of joint probability density functions…

Optimization and Control · Mathematics 2019-09-13 Abhishek Halder , Tryphon T. Georgiou

Sequential Bayesian Filtering aims to estimate the current state distribution of a Hidden Markov Model, given the past observations. The problem is well-known to be intractable for most application domains, except in notable cases such as…

Machine Learning · Statistics 2024-02-16 Théophile Cantelobre , Carlo Ciliberto , Benjamin Guedj , Alessandro Rudi

We study the filtering and smoothing problem for continuous-time linear Gaussian systems. While classical approaches such as the Kalman-Bucy filter and the Rauch-Tung-Striebel (RTS) smoother provide recursive formulas for the conditional…

Statistics Theory · Mathematics 2026-01-06 Masahiro Kurisaki

In this paper, we study the problem of finding mixed Nash equilibrium for mean-field two-player zero-sum games. Solving this problem requires optimizing over two probability distributions. We consider a quasistatic Wasserstein gradient flow…

Computer Science and Game Theory · Computer Science 2022-02-23 Chao Ma , Lexing Ying

We propose a variational method to solve all three estimation problems for nonlinear stochastic dynamical systems: prediction, filtering, and smoothing. Our new approach is based upon a proper choice of cost function, termed the {\it…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Gregory L. Eyink

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

Numerical Analysis · Mathematics 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

We study a variant of the dynamical optimal transport problem in which the energy to be minimised is modulated by the covariance matrix of the distribution. Such transport metrics arise naturally in mean-field limits of certain ensemble…

Analysis of PDEs · Mathematics 2024-12-23 Martin Burger , Matthias Erbar , Franca Hoffmann , Daniel Matthes , André Schlichting

Density deconvolution is the task of estimating a probability density function given only noise-corrupted samples. We can fit a Gaussian mixture model to the underlying density by maximum likelihood if the noise is normally distributed, but…

Machine Learning · Statistics 2020-07-14 Tim Dockhorn , James A. Ritchie , Yaoliang Yu , Iain Murray

We continue the study of adapted optimal transport in the discrete-time Gaussian setting. To this end, we introduce a space of filtered Gaussian processes where both the randomness and the flow of information are driven by a Gaussian white…

Probability · Mathematics 2026-04-27 Madhu Gunasingam , Ting-Kam Leonard Wong

State estimation is critical to control systems, especially when the states cannot be directly measured. This paper presents an approximate optimal filter, which enables to use policy iteration technique to obtain the steady-state gain in…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Kaiming Tang , Shengbo Eben Li , Yuming Yin , Yang Guan , Jingliang Duan , Wenhan Cao , Jie Li

We solve an inverse problem for fluid particle pair-statistics: we show that a time sequence of probability density functions (PDF's) of separations can be exactly reproduced by solving the diffusion equation with a suitable time-dependent…

Fluid Dynamics · Physics 2015-06-16 Gregory L. Eyink , Damien Benveniste

Current tools for multivariate density estimation struggle when the density is concentrated near a nonlinear subspace or manifold. Most approaches require choice of a kernel, with the multivariate Gaussian by far the most commonly used.…

Methodology · Statistics 2021-10-07 Minerva Mukhopadhyay , Didong Li , David B Dunson

We study an approximation method for the one-dimensional nonlinear filtering problem, with discrete time and continuous time observation. We first present the method applied to the Fokker-Planck equation. The convergence of the…

Numerical Analysis · Mathematics 2023-03-29 Fabien F. Campillo

The Wasserstein barycenter problem seeks a probability measure that minimizes the weighted average of the Wasserstein distances to a given collection of probability measures. We study the discrete setting, where each measure has finite…

Optimization and Control · Mathematics 2025-11-07 Jiaqi Wang , Weijun Xie

The Jeffreys divergence is a renown symmetrization of the oriented Kullback-Leibler divergence broadly used in information sciences. Since the Jeffreys divergence between Gaussian mixture models is not available in closed-form, various…

Information Theory · Computer Science 2021-11-24 Frank Nielsen

We consider estimating the parameters of a Gaussian mixture density with a given number of components best representing a given set of weighted samples. We adopt a density interpretation of the samples by viewing them as a discrete Dirac…

Machine Learning · Statistics 2025-04-03 Daniel Frisch , Uwe D. Hanebeck

The projection filter is one of the approximations to the solution of the optimal filtering problem. It approximates the filtering density by projecting the dynamics of the square-root filtering density onto the tangent space of the…

Optimization and Control · Mathematics 2025-09-30 Muhammad Fuady Emzir