English
Related papers

Related papers: Wasserstein Gradient Flows of the Discrepancy with…

200 papers

Maximum mean discrepancy (MMD) flows suffer from high computational costs in large scale computations. In this paper, we show that MMD flows with Riesz kernels $K(x,y) = - \|x-y\|^r$, $r \in (0,2)$ have exceptional properties which allow…

Machine Learning · Computer Science 2024-02-21 Johannes Hertrich , Christian Wald , Fabian Altekrüger , Paul Hagemann

We study geometric properties of the gradient flow for learning deep linear convolutional networks. For linear fully connected networks, it has been shown recently that the corresponding gradient flow on parameter space can be written as a…

Machine Learning · Computer Science 2026-04-07 El Mehdi Achour , Kathlén Kohn , Holger Rauhut

We prove the equivalence between the notion of Wasserstein gradient flow for a one-dimensional nonlocal transport PDE with attractive/repulsive Newtonian potential on one side, and the notion of entropy solution of a Burgers-type scalar…

Analysis of PDEs · Mathematics 2013-10-16 Giovanni A. Bonaschi , José A. Carrillo , Marco Di Francesco , Mark A. Peletier

Motivated by a constrained minimization problem, it is studied the gradient flows with respect to Hessian Riemannian metrics induced by convex functions of Legendre type. The first result characterizes Hessian Riemannian structures on…

Optimization and Control · Mathematics 2018-11-27 Felipe Alvarez , Jérôme Bolte , Olivier Brahic

We study properties of an attractive-repulsive energy functional based on power-kernels, which can be used for halftoning of images. In the first part of this work, using a variational framework for probability measures, we examine…

Analysis of PDEs · Mathematics 2013-10-07 Jan-Christian Hütter

We define new differential structures on the Wasserstein spaces $\mathcal{W}_p(M)$ for $p > 2$ and a general Riemannian manifold $(M,g)$. We consider a very general and possibly degenerate second order partial differential flow equation…

Analysis of PDEs · Mathematics 2026-03-17 Arthur Schichl

In this work, we investigate links between the formulation of the flow of marginals of reversible diffusion processes as gradient flows in the space of probability measures and path wise large deviation principles for sequences of such…

Probability · Mathematics 2014-05-16 Max Fathi

Wasserstein gradient flow (WGF) is a common method to perform optimization over the space of probability measures. While WGF is guaranteed to converge to a first-order stationary point, for nonconvex functionals the converged solution does…

Optimization and Control · Mathematics 2025-09-23 Naoya Yamamoto , Juno Kim , Taiji Suzuki

In this paper, we address the classification of instances each characterized not by a singular point, but by a distribution on a vector space. We employ the Wasserstein metric to measure distances between distributions, which are then used…

Machine Learning · Statistics 2024-05-27 Jia Li , Lin Lin

This work characterizes, analytically and numerically, two major effects of the quadratic Wasserstein ($W_2$) distance as the measure of data discrepancy in computational solutions of inverse problems. First, we show, in the…

Numerical Analysis · Mathematics 2020-06-24 Bjorn Engquist , Kui Ren , Yunan Yang

We use Stein's method to bound the Wasserstein distance of order $2$ between a measure $\nu$ and the Gaussian measure using a stochastic process $(X_t)_{t \geq 0}$ such that $X_t$ is drawn from $\nu$ for any $t > 0$. If the stochastic…

Probability · Mathematics 2020-05-12 Thomas Bonis

The Wasserstein distances $W_p$ ($p\geq 1$), defined in terms of solution to the Monge-Kantorovich problem, are known to be a useful tool to investigate transport equations. In particular, the Benamou-Brenier formula characterizes the…

Analysis of PDEs · Mathematics 2014-11-19 Benedetto Piccoli , Francesco Rossi

We investigate long-time behaviors of empirical measures associated with subordinated Dirichlet diffusion processes on a compact Riemannian manifold $M$ with boundary $\partial M$ to some reference measure, under the quadratic Wasserstein…

Probability · Mathematics 2022-06-09 Huaiqian Li , Bingyao Wu

We study rays and co-rays in the Wasserstein space $P_p(\mathcal{X})$ ($p > 1$) whose ambient space $\mathcal{X}$ is a complete, separable, non-compact, locally compact length space. We show that rays in the Wasserstein space can be…

Dynamical Systems · Mathematics 2019-10-15 Guomin Zhu , Wen-Long Li , Xiaojun Cui

The sliced-Wasserstein flow is an evolution equation where a probability density evolves in time, advected by a velocity field computed as the average among directions in the unit sphere of the optimal transport displacements from its 1D…

Optimization and Control · Mathematics 2024-05-13 Giacomo Cozzi , Filippo Santambogio

We develop a framework for generalized variational inference in infinite-dimensional function spaces and use it to construct a method termed Gaussian Wasserstein inference (GWI). GWI leverages the Wasserstein distance between Gaussian…

Machine Learning · Statistics 2022-10-18 Veit D. Wild , Robert Hu , Dino Sejdinovic

This paper studies convergence of empirical measures smoothed by a Gaussian kernel. Specifically, consider approximating $P\ast\mathcal{N}_\sigma$, for $\mathcal{N}_\sigma\triangleq\mathcal{N}(0,\sigma^2 \mathrm{I}_d)$, by…

Statistics Theory · Mathematics 2020-05-04 Ziv Goldfeld , Kristjan Greenewald , Yury Polyanskiy , Jonathan Weed

Stacking Gaussian Processes severely diminishes the model's ability to detect outliers, which when combined with non-zero mean functions, further extrapolates low non-parametric variance to low training data density regions. We propose a…

Machine Learning · Statistics 2022-02-02 Sebastian Popescu , David Sharp , James Cole , Ben Glocker

The defining equation $(\ast):\ \dot \omega\_t=-F'(\omega\_t),$ of a gradient flow is kinetic in essence. This article explores some dynamical (rather than kinetic) features of gradient flows (i) by embedding equation $(\ast)$ into the…

Probability · Mathematics 2018-06-11 Ivan Gentil , Christian Léonard , Luigia Ripani

Despite the widespread success of Transformers across various domains, their optimization guarantees in large-scale model settings are not well-understood. This paper rigorously analyzes the convergence properties of gradient flow in…

Machine Learning · Statistics 2024-11-01 Cheng Gao , Yuan Cao , Zihao Li , Yihan He , Mengdi Wang , Han Liu , Jason Matthew Klusowski , Jianqing Fan