English
Related papers

Related papers: The back-and-forth method for Wasserstein gradient…

200 papers

We introduce a novel discretization scheme for Wasserstein gradient flows that involves successively computing Schr\"{o}dinger bridges with the same marginals. This is different from both the forward/geodesic approximation and the…

Probability · Mathematics 2024-06-18 Medha Agarwal , Zaid Harchaoui , Garrett Mulcahy , Soumik Pal

This paper presents a new gradient flow dissipation geometry over non-negative and probability measures. This is motivated by a principled construction that combines the unbalanced optimal transport and interaction forces modeled by…

Machine Learning · Computer Science 2024-11-01 Egor Gladin , Pavel Dvurechensky , Alexander Mielke , Jia-Jie Zhu

Many machine learning problems can be expressed as the optimization of some cost functional over a parametric family of probability distributions. It is often beneficial to solve such optimization problems using natural gradient methods.…

Machine Learning · Statistics 2020-02-14 Michael Arbel , Arthur Gretton , Wuchen Li , Guido Montufar

Solving the quantum many-body Schr\"odinger equation is a fundamental and challenging problem in the fields of quantum physics, quantum chemistry, and material sciences. One of the common computational approaches to this problem is Quantum…

Computational Physics · Physics 2023-11-03 Kirill Neklyudov , Jannes Nys , Luca Thiede , Juan Carrasquilla , Qiang Liu , Max Welling , Alireza Makhzani

We consider the statistical inverse problem of estimating a background flow field (e.g., of air or water) from the partial and noisy observation of a passive scalar (e.g., the concentration of a solute), a common experimental approach to…

Numerical Analysis · Mathematics 2019-06-12 Jeff Borggaard , Nathan E. Glatt-Holtz , Justin A. Krometis

In this paper, we address the problem of optimizing flows on generalized graphs that feature multiple entry points and multiple populations, each with varying cost structures. We tackle this problem by considering the multi-population…

Systems and Control · Electrical Eng. & Systems 2025-04-23 Tigran Bakaryan , Christoph Aoun , Ricardo de Lima Ribeiro , Naira Hovakimyan , Diogo Gomes

We present a framework for Nesterov's accelerated gradient flows in probability space to design efficient mean-field Markov chain Monte Carlo (MCMC) algorithms for Bayesian inverse problems. Here four examples of information metrics are…

Optimization and Control · Mathematics 2022-06-27 Yifei Wang , Wuchen Li

Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals with non-smooth Riesz kernels show a rich structure as singular measures can become absolutely continuous ones and conversely. In this paper we contribute to the…

Machine Learning · Computer Science 2024-03-22 Fabian Altekrüger , Johannes Hertrich , Gabriele Steidl

Particle-based variational inference methods (ParVIs) such as Stein variational gradient descent (SVGD) update the particles based on the kernelized Wasserstein gradient flow for the Kullback-Leibler (KL) divergence. However, the design of…

Machine Learning · Statistics 2023-10-26 Ziheng Cheng , Shiyue Zhang , Longlin Yu , Cheng Zhang

We propose a projected Wasserstein gradient descent method (pWGD) for high-dimensional Bayesian inference problems. The underlying density function of a particle system of WGD is approximated by kernel density estimation (KDE), which faces…

Machine Learning · Computer Science 2021-02-16 Yifei Wang , Peng Chen , Wuchen Li

In this paper we present a numerical scheme for nonlinear continuity equations, which is based on the gradient flow formulation of an energy functional with respect to the quadratic transportation distance. It can be applied to a large…

Numerical Analysis · Mathematics 2016-11-23 José A. Carrillo , Helene Ranetbauer , Marie-Therese Wolfram

We propose a new formulation and learning strategy for computing the Wasserstein geodesic between two probability distributions in high dimensions. By applying the method of Lagrange multipliers to the dynamic formulation of the optimal…

Machine Learning · Computer Science 2021-06-08 Shu Liu , Shaojun Ma , Yongxin Chen , Hongyuan Zha , Haomin Zhou

We consider a general optimal control problem in the setting of gradient flows. Two approximations of the problem are presented, both relying on the variational reformulation of gradient-flow dynamics via the Weighted-Energy-Dissipation…

Optimization and Control · Mathematics 2024-03-25 Takeshi Fukao , Ulisse Stefanelli , Riccardo Voso

We consider a Fokker-Planck equation which is coupled to an externally given time-dependent constraint on its first moment. This constraint introduces a Lagrange-multiplier which renders the equation nonlocal and nonlinear. In this paper we…

Analysis of PDEs · Mathematics 2018-11-28 Simon Eberle , Barbara Niethammer , André Schlichting

We consider the gradient flow structure of the porous medium equations with non-negative constant Dirichlet boundary conditions. We construct weak solutions to the equations via the minimizing movement scheme by considering an entropy…

Analysis of PDEs · Mathematics 2025-05-30 Dongkwang Kim , Dowan Koo , Geuntaek Seo

We develop a gradient-flow framework based on the Wasserstein metric for a parabolic moving-boundary problem that models crystal dissolution and precipitation. In doing so we derive a new weak formulation for this moving-boundary problem…

Mathematical Physics · Physics 2010-03-12 Jacobus W. Portegies , Mark A. Peletier

Wasserstein Gradient Flows (WGF) with respect to specific functionals have been widely used in the machine learning literature. Recently, neural networks have been adopted to approximate certain intractable parts of the underlying…

Machine Learning · Computer Science 2024-01-26 Huminhao Zhu , Fangyikang Wang , Chao Zhang , Hanbin Zhao , Hui Qian

We propose efficient numerical schemes for implementing the natural gradient descent (NGD) for a broad range of metric spaces with applications to PDE-based optimization problems. Our technique represents the natural gradient direction as a…

Optimization and Control · Mathematics 2023-01-12 Levon Nurbekyan , Wanzhou Lei , Yunan Yang

Many studies have been conducted on flows of probability measures, often in terms of gradient flows. We utilize a generalized notion of derivatives with respect to time to model the instantaneous evolution of empirically observed…

Methodology · Statistics 2021-09-16 Yaqing Chen , Hans-Georg Müller

On the flat torus in any dimension we prove existence of a solution to the TV Wasserstein gradient flow equation, only assuming that the initial density $\rho_0$ is bounded from below and above by strictly positive constants. This solution…

Analysis of PDEs · Mathematics 2026-02-02 Kexin Lin , Filippo Santambrogio