English
Related papers

Related papers: Implicit Bias of the JKO Scheme

200 papers

It is shown that the distribution of the lowest energy eigenvalue of the quantum completions of Jackiw-Teitelboim gravity is completely described by a non-linear ordinary differential equation (ODE) arising from a non-perturbative treatment…

High Energy Physics - Theory · Physics 2022-06-03 Clifford V. Johnson

We propose a variational form of the BDF2 method as an alternative to the commonly used minimizing movement scheme for the time-discrete approximation of gradient flows in abstract metric spaces. Assuming uniform semi-convexity --- but no…

Analysis of PDEs · Mathematics 2017-12-25 Daniel Matthes , Simon Plazotta

Motivated by recent developments in the fields of large deviations for interacting particle system and mean field control, we establish a comparison principle for the Hamilton--Jacobi equation corresponding to linearly controlled gradient…

Analysis of PDEs · Mathematics 2024-01-08 Giovanni Conforti , Richard Kraaij , Daniela Tonon

Two geometrical structures have been extensively studied for a manifold of probability distributions. One is based on the Fisher information metric, which is invariant under reversible transformations of random variables, while the other is…

Optimization and Control · Mathematics 2017-10-02 Shun-ichi Amari , Ryo Karakida , Masafumi Oizumi

Gradient descent-ascent (GDA) flows play a central role in finding saddle points of bivariate functionals, with applications in optimization, game theory, and robust control. While they are well-understood in Hilbert and Banach spaces via…

Functional Analysis · Mathematics 2025-06-26 Noboru Isobe , Sho Shimoyama

We propose a fully discrete variational scheme for nonlinear evolution equations with gradient flow structure on the space of finite Radon measures on an interval with respect to a generalized version of the Wasserstein distance with…

Numerical Analysis · Mathematics 2016-09-29 Jonathan Zinsl , Daniel Matthes

The space of probability densities is an infinite-dimensional Riemannian manifold, with Riemannian metrics in two flavors: Wasserstein and Fisher--Rao. The former is pivotal in optimal mass transport (OMT), whereas the latter occurs in…

Differential Geometry · Mathematics 2017-11-21 Klas Modin

Distributionally robust optimization (DRO) is an effective approach for data-driven decision-making in the presence of uncertainty. Geometric uncertainty due to sampling or localized perturbations of data points is captured by Wasserstein…

Machine Learning · Statistics 2023-11-10 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

We study the contraction in Wasserstein distance of the coordinate ascent variational inference algorithm. This is shown to hold under a transport-information inequality at the fixed points and a functional smoothness condition. The results…

Machine Learning · Statistics 2026-05-29 Rocco Caprio , Adrien Corenflos , Sam Power

This paper provides results on Wasserstein gradient flows between measures on the real line. Utilizing the isometric embedding of the Wasserstein space $\mathcal P_2(\mathbb R)$ into the Hilbert space $L_2((0,1))$, Wasserstein gradient…

Optimization and Control · Mathematics 2024-08-13 Johannes Hertrich , Robert Beinert , Manuel Gräf , Gabriele Steidl

Solving Fredholm equations of the first kind is crucial in many areas of the applied sciences. In this work we adopt a probabilistic and variational point of view by considering a minimization problem in the space of probability measures…

Optimization and Control · Mathematics 2024-05-17 Francesca R. Crucinio , Valentin De Bortoli , Arnaud Doucet , Adam M. Johansen

Efficient gradient computation of the Jacobian determinant term is a core problem in many machine learning settings, and especially so in the normalizing flow framework. Most proposed flow models therefore either restrict to a function…

Machine Learning · Computer Science 2021-06-10 T. Anderson Keller , Jorn W. T. Peters , Priyank Jaini , Emiel Hoogeboom , Patrick Forré , Max Welling

Piecewise $\alpha$-stable Ornstein-Uhlenbeck (OU) processes arising in queue networks usually do not have an explicit dissipation, which makes the related numerical methods such as Euler-Maruyama (EM) scheme more difficult to analyze. We…

Probability · Mathematics 2024-11-11 Xinghu Jin , Guodong Pang , Yu Wang , Lihu Xu

Distributionally robust optimization (DRO) has emerged as a powerful paradigm for reliable decision-making under uncertainty. This paper focuses on DRO with ambiguity sets defined via the Sinkhorn discrepancy: an entropy-regularized…

Machine Learning · Statistics 2025-12-16 Jie Wang

Michor and Mumford showed that the mean curvature flow is a gradient flow on a Riemannian structure with a degenerate geodesic distance. It is also known to destroy the uniform density of gridpoints on the evolving surfaces. We introduce a…

Analysis of PDEs · Mathematics 2018-09-18 Wenhui Shi , Dmitry Vorotnikov

Among dissimilarities between probability distributions, the Kernel Stein Discrepancy (KSD) has received much interest recently. We investigate the properties of its Wasserstein gradient flow to approximate a target probability distribution…

Machine Learning · Statistics 2021-05-24 Anna Korba , Pierre-Cyril Aubin-Frankowski , Szymon Majewski , Pierre Ablin

In this paper we establish a rigorous gradient flow structure for one-dimensional Kimura equations with respect to some Wasserstein-Shahshahani optimal transport geometry. This is achieved by first conditioning the underlying stochastic…

Analysis of PDEs · Mathematics 2022-10-03 Jean-Baptiste Casteras , Léonard Monsaingeon

This study focuses on a Wasserstein-type gradient flow, which represents an optimization process of a continuous model of a Deep Neural Network (DNN). First, we establish the existence of a minimizer for an average loss of the model under…

Machine Learning · Computer Science 2024-04-16 Noboru Isobe

In this work, we study the Wasserstein gradient flow of the Riesz energy defined on the space of probability measures. The Riesz kernels define a quadratic functional on the space of measure which is not in general geodesically convex in…

Analysis of PDEs · Mathematics 2024-01-30 Siwan Boufadène , François-Xavier Vialard

Given any closed Riemannian manifold $M$, we construct a reversible diffusion process on the space ${\mathcal P}(M)$ of probability measures on $M$ that is (i) reversible w.r.t.~the entropic measure ${\mathbb P}^\beta$ on ${\mathcal P}(M)$,…

Probability · Mathematics 2024-04-25 Karl-Theodor Sturm