English
Related papers

Related papers: Algorithms for mean-field variational inference vi…

200 papers

In finite-dimensions, minimal surfaces that fill in the space delineated by closed curves and have minimal area arose naturally in classical physics in several contexts. No such concept seems readily available in infinite dimensions. The…

Optimization and Control · Mathematics 2023-06-27 Wuchen Li , Tryphon T. Georgiou

We study the quantitative convergence of drift-diffusion PDEs that arise as Wasserstein gradient flows of linearly convex functions over the space of probability measures on ${\mathbb R}^d$. In this setting, the objective is in general not…

Optimization and Control · Mathematics 2025-07-17 Lénaïc Chizat , Maria Colombo , Xavier Fernández-Real

Wasserstein barycenter, built on the theory of optimal transport, provides a powerful framework to aggregate probability distributions, and it has increasingly attracted great attention within the machine learning community. However, it…

Machine Learning · Computer Science 2022-12-20 Jinjin Chi , Zhiyao Yang , Jihong Ouyang , Ximing Li

This article considers Bayesian model selection via mean-field (MF) variational approximation. Towards this goal, we study the non-asymptotic properties of MF inference under the Bayesian framework that allows latent variables and model…

Methodology · Statistics 2023-12-29 Yangfan Zhang , Yun Yang

Impractical assumptions, an inherently myopic nature, and the crucial role of the initial design, all together contribute to making theoretical convergence proofs of little value in real-life Bayesian Optimization applications. In this…

Optimization and Control · Mathematics 2026-02-13 Antonio Candelieri , Francesco Archetti

Stein's method has been widely used for probability approximations. However, in the multi-dimensional setting, most of the results are for multivariate normal approximation or for test functions with bounded second- or higher-order…

Probability · Mathematics 2018-08-16 Xiao Fang , Qi-Man Shao , Lihu Xu

We present a novel multiscale framework for analyzing sequences of probability measures in Wasserstein spaces over Euclidean domains. Exploiting the intrinsic geometry of optimal transport, we construct a multiscale transform applicable to…

Numerical Analysis · Mathematics 2026-04-13 Wael Mattar , Nir Sharon

We present a computationally efficient framework, called $\texttt{FlowDRO}$, for solving flow-based distributionally robust optimization (DRO) problems with Wasserstein uncertainty sets while aiming to find continuous worst-case…

Machine Learning · Computer Science 2024-02-27 Chen Xu , Jonghyeok Lee , Xiuyuan Cheng , Yao Xie

Semi-implicit variational inference (SIVI) enhances the expressiveness of variational families through hierarchical semi-implicit distributions, but the intractability of their densities makes standard ELBO-based optimization biased. Recent…

Machine Learning · Statistics 2026-01-21 Longlin Yu , Ziheng Cheng , Shiyue Zhang , Cheng Zhang

Particle based optimization algorithms have recently been developed as sampling methods that iteratively update a set of particles to approximate a target distribution. In particular Stein variational gradient descent has gained attention…

Machine Learning · Computer Science 2021-03-19 Francesco D'Angelo , Vincent Fortuin

In this article, we formulate topology optimization problems concerning the mass distribution as minimization problems for functionals on the Wasserstein space. We relax optimization problems regarding non-convex objective functions on the…

Optimization and Control · Mathematics 2026-01-22 Fumiya Okazaki , Takayuki Yamada

We study the Stein Variational Gradient Descent (SVGD) algorithm, which optimises a set of particles to approximate a target probability distribution $\pi\propto e^{-V}$ on $\mathbb{R}^d$. In the population limit, SVGD performs gradient…

Machine Learning · Statistics 2021-01-05 Anna Korba , Adil Salim , Michael Arbel , Giulia Luise , Arthur Gretton

We establish a general inequality on the Poisson space, yielding an upper bound for the distance in total variation between the law of a regular random variable with values in the integers and a Poisson distribution. Several applications…

Probability · Mathematics 2012-04-18 Giovanni Peccati

Von Renesse and the author (Ann. Prob. '09) developed a second order calculus on the Wasserstein space P([0,1]) of probability measures on the unit interval. The basic objects of interest had been Dirichlet form, semigroup and continuous…

Probability · Mathematics 2011-05-20 Karl-Theodor Sturm

Policy optimization is a core component of reinforcement learning (RL), and most existing RL methods directly optimize parameters of a policy based on maximizing the expected total reward, or its surrogate. Though often achieving…

Machine Learning · Computer Science 2018-08-10 Ruiyi Zhang , Changyou Chen , Chunyuan Li , Lawrence Carin

Optimization over the space of probability measures endowed with the Wasserstein-2 geometry is central to modern machine learning and mean-field modeling. However, traditional methods relying on full Wasserstein gradients often suffer from…

Machine Learning · Statistics 2026-04-03 Yewei Xu , Qin Li

We construct a Wasserstein gradient flow of the maximum mean discrepancy (MMD) and study its convergence properties. The MMD is an integral probability metric defined for a reproducing kernel Hilbert space (RKHS), and serves as a metric on…

Machine Learning · Statistics 2019-12-04 Michael Arbel , Anna Korba , Adil Salim , Arthur Gretton

We introduce and study the class of totally dissipative multivalued probability vector fields (MPVF) $\boldsymbol{\mathrm F}$ on the Wasserstein space $(\mathcal{P}_2(\mathsf{X}),W_2)$ of Euclidean or Hilbertian probability measures. We…

Functional Analysis · Mathematics 2026-04-08 Giulia Cavagnari , Giuseppe Savaré , Giacomo Enrico Sodini

Multivariate functions encountered in high-dimensional uncertainty quantification problems often vary most strongly along a few dominant directions in the input parameter space. We propose a gradient-based method for detecting these…

Analysis of PDEs · Mathematics 2019-11-11 Olivier Zahm , Paul Constantine , Clémentine Prieur , Youssef Marzouk

This paper is concerned by statistical inference problems from a data set whose elements may be modeled as random probability measures such as multiple histograms or point clouds. We propose to review recent contributions in statistics on…

Statistics Theory · Mathematics 2019-08-27 Jérémie Bigot
‹ Prev 1 3 4 5 6 7 10 Next ›