English
Related papers

Related papers: Deep JKO: time-implicit particle methods for gener…

200 papers

The so-called JKO scheme, named after Jordan, Kinderlehrer and Otto, provides a variational way to construct discrete time approximations of certain partial differential equations (PDEs) appearing as gradient flows in the space of…

Analysis of PDEs · Mathematics 2026-04-10 Aymeric Baradat , Sofiane Cherf

In this paper we devote our attention to a class of weighted ultrafast diffusion equations arising from the problem of quantisation for probability measures. These equations have a natural gradient flow structure in the space of probability…

Analysis of PDEs · Mathematics 2019-01-30 Mikaela Iacobelli , Francesco Patacchini , Filippo Santambrogio

The JKO scheme is a time-discrete scheme of implicit Euler type that allows to construct weak solutions of evolution PDEs which have a Wasserstein gradient structure. The purpose of this work is to study the effect of replacing the…

Analysis of PDEs · Mathematics 2025-02-19 Aymeric Baradat , Anastasiia Hraivoronska , Filippo Santambrogio

We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as the limit of…

Machine Learning · Statistics 2018-06-13 Charlie Frogner , Tomaso Poggio

Efficient gradient computation of the Jacobian determinant term is a core problem in many machine learning settings, and especially so in the normalizing flow framework. Most proposed flow models therefore either restrict to a function…

Machine Learning · Computer Science 2021-06-10 T. Anderson Keller , Jorn W. T. Peters , Priyank Jaini , Emiel Hoogeboom , Patrick Forré , Max Welling

Gradient flows of the Kullback--Leibler (KL) divergence, such as the Fokker--Planck equation and Stein Variational Gradient Descent, evolve a distribution toward a target density known only up to a normalizing constant. We introduce new…

Machine Learning · Statistics 2026-02-09 Elias Hess-Childs , Dejan Slepčev , Lantian Xu

We study ``nonlocal diffusion equations'' of the form \[ \partial_{t}\frac{d\rho_{t}}{d\pi}(x)+\int_{X}\left(\frac{d\rho_{t}}{d\pi}(x)-\frac{d\rho_{t}}{d\pi}(y)\right)\eta(x,y)d\pi(y)=0\qquad(\dagger) \] where $X$ is either $\mathbb{R}^{d}$…

Analysis of PDEs · Mathematics 2025-11-03 Andrew Warren

Vision-Language Latent Diffusion Models (LDMs) (Rombach et al., 2022) provide powerful generative priors for inverse problems. However, existing LDM-based inverse solvers typically require a large number of neural function evaluations…

Machine Learning · Statistics 2026-05-11 Alessio Spagnoletti , Tim Y. J. Wang , Marcelo Pereyra , O. Deniz Akyildiz

Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals with non-smooth Riesz kernels show a rich structure as singular measures can become absolutely continuous ones and conversely. In this paper we contribute to the…

Machine Learning · Computer Science 2024-03-22 Fabian Altekrüger , Johannes Hertrich , Gabriele Steidl

Otto's (2001) Wasserstein gradient flow of the exclusive KL divergence functional provides a powerful and mathematically principled perspective for analyzing learning and inference algorithms. In contrast, algorithms for the inclusive KL…

Machine Learning · Statistics 2024-11-04 Jia-Jie Zhu

We propose a variational scheme for computing Wasserstein gradient flows. The scheme builds upon the Jordan--Kinderlehrer--Otto framework with the Benamou-Brenier's dynamic formulation of the quadratic Wasserstein metric and adds a…

Numerical Analysis · Mathematics 2020-07-15 Wuchen Li , Jianfeng Lu , Li Wang

The Poisson-Nernst-Planck system of equations used to model ionic transport is interpreted as a gradient flow for the Wasserstein distance and a free energy in the space of probability measures with finite second moment. A variational…

Analysis of PDEs · Mathematics 2015-09-08 David Kinderlehrer , Léonard Monsaingeon , Xiang Xu

We develop a new computational framework to solve the partial differential equations (PDEs) governing the flow of the joint probability density functions (PDFs) in continuous-time stochastic nonlinear systems. The need for computing the…

Optimization and Control · Mathematics 2019-08-08 Kenneth F. Caluya , Abhishek Halder

The Wasserstein gradient flow structure of the PDE system governing multiphase flows in porous media was recently highlighted in [C. Canc\`es, T. O. Gallou\"et, and L. Monsaingeon, {\it Anal. PDE} 10(8):1845--1876, 2017]. The model can thus…

Numerical Analysis · Mathematics 2018-07-23 Clément Cancès , Thomas O. Gallouët , Maxime Laborde , Léonard Monsaingeon

We develop a fast and scalable numerical approach to solve Wasserstein gradient flows (WGFs), particularly suitable for high-dimensional cases. Our approach is to use general reduced-order models, like deep neural networks, to parameterize…

Numerical Analysis · Mathematics 2024-05-24 Yijie Jin , Shu Liu , Hao Wu , Xiaojing Ye , Haomin Zhou

This paper contains two contributions in the study of optimal transport on metric graphs. Firstly, we prove a Benamou-Brenier formula for the Wasserstein distance, which establishes the equivalence of static and dynamical optimal transport.…

Analysis of PDEs · Mathematics 2022-05-02 Matthias Erbar , Dominik Forkert , Jan Maas , Delio Mugnolo

We develop in this paper a new regularized flow dynamic approach to construct efficient numerical schemes for Wasserstein gradient flows in Lagrangian coordinates. Instead of approximating the Wasserstein distance which needs to solve…

Numerical Analysis · Mathematics 2024-06-24 Qing Cheng , Qianqian Liu , Wenbin Chen , Jie Shen

The dynamical formulation of the optimal transport can be extended through various choices of the underlying geometry (kinetic energy), and the regularization of density paths (potential energy). These combinations yield different…

Machine Learning · Computer Science 2024-07-04 Kirill Neklyudov , Rob Brekelmans , Alexander Tong , Lazar Atanackovic , Qiang Liu , Alireza Makhzani

In this article we set up a splitting variant of the JKO scheme in order to handle gradient flows with respect to the Kantorovich-Fisher-Rao metric, recently introduced and defined on the space of positive Radon measure with varying masses.…

Analysis of PDEs · Mathematics 2018-05-08 Thomas Gallouët , Léonard Monsaingeon

We provide a numerical analysis and computation of neural network projected schemes for approximating one dimensional Wasserstein gradient flows. We approximate the Lagrangian mapping functions of gradient flows by the class of two-layer…

Numerical Analysis · Mathematics 2024-02-27 Xinzhe Zuo , Jiaxi Zhao , Shu Liu , Stanley Osher , Wuchen Li