English
Related papers

Related papers: Optimizing Functionals on the Space of Probabiliti…

200 papers

Minimizing functionals in the space of probability distributions can be done with Wasserstein gradient flows. To solve them numerically, a possible approach is to rely on the Jordan-Kinderlehrer-Otto (JKO) scheme which is analogous to the…

Machine Learning · Computer Science 2022-11-16 Clément Bonet , Nicolas Courty , François Septier , Lucas Drumetz

We develop novel neural network-based implicit particle methods to compute high-dimensional Wasserstein-type gradient flows with linear and nonlinear mobility functions. The main idea is to use the Lagrangian formulation in the…

Numerical Analysis · Mathematics 2023-11-14 Wonjun Lee , Li Wang , Wuchen Li

Wasserstein gradient flows provide a powerful means of understanding and solving many diffusion equations. Specifically, Fokker-Planck equations, which model the diffusion of probability measures, can be understood as gradient descent over…

Machine Learning · Computer Science 2021-10-26 Petr Mokrov , Alexander Korotin , Lingxiao Li , Aude Genevay , Justin Solomon , Evgeny Burnaev

This paper studies the convergence properties of the inexact Jordan-Kinderlehrer-Otto (JKO) scheme and proximal-gradient algorithm in the context of Wasserstein spaces. The JKO scheme, a widely-used method for approximating solutions to…

Optimization and Control · Mathematics 2025-06-19 Simone Di Marino , Emanuele Naldi , Silvia Villa

Normalizing flow is a class of deep generative models for efficient sampling and likelihood estimation, which achieves attractive performance, particularly in high dimensions. The flow is often implemented using a sequence of invertible…

Machine Learning · Statistics 2024-02-19 Chen Xu , Xiuyuan Cheng , Yao Xie

Wasserstein gradient flow has emerged as a promising approach to solve optimization problems over the space of probability distributions. A recent trend is to use the well-known JKO scheme in combination with input convex neural networks to…

Machine Learning · Computer Science 2022-07-26 Jiaojiao Fan , Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

We analyze the gradient flow of a potential energy in the space of probability measures when we substitute the optimal transport geometry with a geometry based on Sinkhorn divergences, a debiased version of entropic optimal transport. This…

Analysis of PDEs · Mathematics 2025-11-19 Mathis Hardion , Hugo Lavenant

We consider a minimax problem motivated by distributionally robust optimization (DRO) when the worst-case distribution is continuous, leading to significant computational challenges due to the infinite-dimensional nature of the optimization…

Machine Learning · Statistics 2024-12-31 Linglingzhi Zhu , Yao Xie

Wasserstein gradient flow provides a general framework for minimizing an energy functional $J$ over the space of probability measures on a Riemannian manifold $(M,g)$. Its canonical time-discretization, the Jordan-Kinderlehrer-Otto (JKO)…

Machine Learning · Statistics 2026-03-05 Peter Halmos , Boris Hanin

Motivated by the computation of the non-parametric maximum likelihood estimator (NPMLE) and the Bayesian posterior in statistics, this paper explores the problem of convex optimization over the space of all probability distributions. We…

Statistics Theory · Mathematics 2023-11-03 Rentian Yao , Linjun Huang , Yun Yang

We introduce a deep neural network-based numerical method for solving kinetic Fokker Planck equations, including both linear and nonlinear cases. Building upon the conservative dissipative structure of Vlasov-type equations, we formulate a…

Numerical Analysis · Mathematics 2026-03-26 Wonjun Lee , Li Wang , Wuchen Li

In order to sample from an unnormalized probability density function, we propose to combine continuous normalizing flows (CNFs) with rejection-resampling steps based on importance weights. We relate the iterative training of CNFs with…

Machine Learning · Statistics 2025-08-14 Johannes Hertrich , Robert Gruhlke

The seminal paper of Jordan, Kinderlehrer, and Otto introduced what is now widely known as the JKO scheme, an iterative algorithmic framework for computing distributions. This scheme can be interpreted as a Wasserstein gradient flow and has…

Machine Learning · Statistics 2025-01-15 Shang Wu , Yazhen Wang

Diffusion-based models on continuous spaces have seen substantial recent progress through the mathematical framework of gradient flows, leveraging the Wasserstein-2 (${W}_2$) metric via the Jordan-Kinderlehrer-Otto (JKO) scheme. Despite the…

Machine Learning · Computer Science 2026-04-14 Dario Rancati , Jan Maas , Francesco Locatello

This paper proposes an input convex neural network (ICNN)-Assisted optimal power flow (OPF) in distribution networks. Instead of relying purely on optimization or machine learning, the ICNN-Assisted OPF is a combination of optimization and…

Systems and Control · Electrical Eng. & Systems 2024-07-31 Rui Cheng , Yuze Yang , Wenxia Liu , Nian Liu , Zhaoyu Wang

We propose a consistency model based on the optimal-transport flow. A physics-informed design of partially input-convex neural networks (PICNN) plays a central role in constructing the flow field that emulates the displacement…

Machine Learning · Computer Science 2025-11-11 Fanghui Song , Zhongjian Wang , Jiebao Sun

The gradients of convex functions are expressive models of non-trivial vector fields. For example, Brenier's theorem yields that the optimal transport map between any two measures on Euclidean space under the squared distance is realized as…

Machine Learning · Computer Science 2021-11-25 Jack Richter-Powell , Jonathan Lorraine , Brandon Amos

Gradient flows in the Wasserstein space have become a powerful tool in the analysis of diffusion equations, following the seminal work of Jordan, Kinderlehrer and Otto (JKO). The numerical applications of this formulation have been limited…

Numerical Analysis · Mathematics 2014-08-21 Jean-David Benamou , Guillaume Carlier , Quentin Mérigot , Edouard Oudet

The purpose of this work is mostly expository and aims to elucidate the Jordan-Kinderlehrer-Otto (JKO) scheme for uncertainty propagation, and a variant, the Laugesen-Mehta-Meyn-Raginsky (LMMR) scheme for filtering. We point out that these…

Optimization and Control · Mathematics 2017-10-03 Abhishek Halder , Tryphon T. Georgiou

The Jordan-Kinderlehrer-Otto (JKO) scheme provides a stable variational framework for computing Wasserstein gradient flows, but its practical use is often limited by the high computational cost of repeatedly solving the JKO subproblems. We…

Machine Learning · Computer Science 2026-01-12 Xue Feng , Li Wang , Deanna Needell , Rongjie Lai
‹ Prev 1 2 3 10 Next ›