English
Related papers

Related papers: Efficient Gradient Flows in Sliced-Wasserstein Spa…

200 papers

In this article, we introduce a new approach towards the statistical learning problem $\operatorname{argmin}_{\rho(\theta) \in \mathcal P_{\theta}} W_{Q}^2 (\rho_{\star},\rho(\theta))$ to approximate a target quantum state $\rho_{\star}$ by…

Mathematical Physics · Physics 2021-02-03 Simon Becker , Wuchen Li

Policy gradients methods often achieve better performance when the change in policy is limited to a small Kullback-Leibler divergence. We derive policy gradients where the change in policy is limited to a small Wasserstein distance (or…

Machine Learning · Computer Science 2017-12-21 Pierre H. Richemond , Brendan Maginnis

This paper presents a Wasserstein attraction approach for solving dynamic mass transport problems over networks. In the transport problem over networks, we start with a distribution over the set of nodes that needs to be "transported" to a…

Optimization and Control · Mathematics 2022-04-28 Ferran Arqué , César A. Uribe , Carlos Ocampo-Martinez

Sliced Wasserstein (SW) distances offer an efficient method for comparing high-dimensional probability measures by projecting them onto multiple 1-dimensional probability distributions. However, identifying informative slicing directions…

Machine Learning · Computer Science 2025-06-04 Navid NaderiAlizadeh , Darian Salehi , Xinran Liu , Soheil Kolouri

The sliced-Wasserstein flow is an evolution equation where a probability density evolves in time, advected by a velocity field computed as the average among directions in the unit sphere of the optimal transport displacements from its 1D…

Optimization and Control · Mathematics 2024-05-13 Giacomo Cozzi , Filippo Santambogio

We propose a Variable-Preconditioned Transformed Primal-Dual (VPTPD) method for solving generalized Wasserstein gradient flows based on the structure-preserving JKO scheme. This is a nontrivial extension of the TPD method [Chen et al.…

Numerical Analysis · Mathematics 2025-10-22 Jin Zeng , Dawei Zhan , Ruchi Guo , Chaozhen Wei

There has been recent interest in developing scalable Bayesian sampling methods such as stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD) for big-data analysis. A standard SG-MCMC algorithm simulates samples…

Machine Learning · Statistics 2018-07-11 Changyou Chen , Ruiyi Zhang , Wenlin Wang , Bai Li , Liqun Chen

Wasserstein-Fisher-Rao (WFR) gradient flows have been recently proposed as a powerful sampling tool that combines the advantages of pure Wasserstein (W) and pure Fisher-Rao (FR) gradient flows. Existing algorithmic developments implicitly…

Machine Learning · Statistics 2026-03-02 Francesca Romana Crucinio , Sahani Pathiraja

We introduce a framework for Newton's flows in probability space with information metrics, named information Newton's flows. Here two information metrics are considered, including both the Fisher-Rao metric and the Wasserstein-2 metric. A…

Optimization and Control · Mathematics 2020-08-06 Yifei Wang , Wuchen Li

The propagation of gradient flow structures from microscopic to macroscopic models is a topic of high current interest. In this paper we discuss this propagation in a model for the diffusion of particles interacting via hard-core exclusion…

Analysis of PDEs · Mathematics 2020-08-18 Maria Bruna , Martin Burger , José Antonio Carrillo

The sliced Wasserstein flow (SWF), a nonparametric and implicit generative gradient flow, is transformed into a Liouville partial differential equation (PDE)-based formalism. First, the stochastic diffusive term from the Fokker-Planck…

Machine Learning · Statistics 2026-05-12 Jayshawn Cooper , Pilhwa Lee

The Wasserstein metric is broadly used in optimal transport for comparing two probabilistic distributions, with successful applications in various fields such as machine learning, signal processing, seismic inversion, etc. Nevertheless, the…

Optimization and Control · Mathematics 2022-02-22 Qichen Liao , Jing Chen , Zihao Wang , Bo Bai , Shi Jin , Hao Wu

Many machine learning problems can be seen as approximating a \textit{target} distribution using a \textit{particle} distribution by minimizing their statistical discrepancy. Wasserstein Gradient Flow can move particles along a path that…

Machine Learning · Statistics 2024-06-07 Song Liu , Jiahao Yu , Jack Simons , Mingxuan Yi , Mark Beaumont

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Machine Learning · Statistics 2019-06-12 Antoine Liutkus , Umut Şimşekli , Szymon Majewski , Alain Durmus , Fabian-Robert Stöter

Wasserstein distance-based distributionally robust optimization (DRO) has received much attention lately due to its ability to provide a robustness interpretation of various learning models. Moreover, many of the DRO problems that arise in…

Optimization and Control · Mathematics 2019-10-29 Jiajin Li , Sen Huang , Anthony Man-Cho So

We revisit the variational characterization of diffusion as entropic gradient flux and provide for it a probabilistic interpretation based on stochastic calculus. It was shown by Jordan, Kinderlehrer, and Otto that, for diffusions of…

Probability · Mathematics 2020-03-24 Ioannis Karatzas , Walter Schachermayer , Bertram Tschiderer

We study a natural Wasserstein gradient flow on manifolds of probability distributions with discrete sample spaces. We derive the Riemannian structure for the probability simplex from the dynamical formulation of the Wasserstein distance on…

Optimization and Control · Mathematics 2021-04-19 Wuchen Li , Guido Montufar

Solutions of certain partial differential equations (PDEs) are often represented by the steepest descent curves of corresponding functionals. Minimizing movement scheme was developed in order to study such curves in metric spaces.…

Numerical Analysis · Mathematics 2023-10-09 Min Sue Park , Cheolhyeong Kim , Hwijae Son , Hyung Ju Hwang

We present a novel multiscale framework for analyzing sequences of probability measures in Wasserstein spaces over Euclidean domains. Exploiting the intrinsic geometry of optimal transport, we construct a multiscale transform applicable to…

Numerical Analysis · Mathematics 2026-04-13 Wael Mattar , Nir Sharon

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart