English
Related papers

Related papers: Atomic Gradient Flows: Gradient Flows on Sparse Re…

200 papers

Wasserstein gradient flows provide a powerful means of understanding and solving many diffusion equations. Specifically, Fokker-Planck equations, which model the diffusion of probability measures, can be understood as gradient descent over…

Machine Learning · Computer Science 2021-10-26 Petr Mokrov , Alexander Korotin , Lingxiao Li , Aude Genevay , Justin Solomon , Evgeny Burnaev

Motivated by approximation Bayesian computation using mean-field variational approximation and the computation of equilibrium in multi-species systems with cross-interaction, this paper investigates the composite geodesically convex…

Optimization and Control · Mathematics 2024-09-18 Rentian Yao , Xiaohui Chen , Yun Yang

In this paper, we address the optimization problem of minimizing $Q(df_x)$ over a Hadamard manifold ${\cal M}$, where $f$ is a convex function on ${\cal M}$, $df_x$ is the differential of $f$ at $x \in {\cal M}$, and $Q$ is a function on…

Optimization and Control · Mathematics 2026-01-23 Hiroshi Hirai

Variational inference (VI) can be cast as an optimization problem in which the variational parameters are tuned to closely align a variational distribution with the true posterior. The optimization task can be approached through vanilla…

Machine Learning · Computer Science 2025-04-24 Dai Hai Nguyen , Tetsuya Sakurai , Hiroshi Mamitsuka

Gradient descent (GD) methods for the training of artificial neural networks (ANNs) belong nowadays to the most heavily employed computational schemes in the digital world. Despite the compelling success of such methods, it remains an open…

Optimization and Control · Mathematics 2025-09-01 Shokhrukh Ibragimov , Arnulf Jentzen , Adrian Riekert

We develop a new computational framework to solve the partial differential equations (PDEs) governing the flow of the joint probability density functions (PDFs) in continuous-time stochastic nonlinear systems. The need for computing the…

Optimization and Control · Mathematics 2019-08-08 Kenneth F. Caluya , Abhishek Halder

Recently, through a unified gradient flow perspective of Markov chain Monte Carlo (MCMC) and variational inference (VI), particle-based variational inference methods (ParVIs) have been proposed that tend to combine the best of both worlds.…

Machine Learning · Statistics 2024-10-31 Shiyue Zhang , Longlin Yu , Ziheng Cheng , Cheng Zhang

Flow Matching has become a cornerstone of modern generative models like Stable Diffusion 3, largely due to the efficiency of its Rectified Flow (RF) variant. The success of RF hinges on iteratively learning straight trajectories, pushing…

Machine Learning · Computer Science 2026-05-19 Vansh Bansal , Saptarshi Roy , Purnamrita Sarkar , Alessandro Rinaldo

In this paper we study a perturbative approach to the problem of quantization of measures in the plane. Motivated by the fact that, as the number of points tends to infinity, hexagonal lattices are asymptotically optimal from an energetic…

Analysis of PDEs · Mathematics 2018-09-18 Emanuele Caglioti , François Golse , Mikaela Iacobelli

We study the Wasserstein gradient flow of semi-discrete energies in the space of probability measures, that is functionals depending on two measures-one being an absolutely continuous density and the other an atomic measure. These energies…

Analysis of PDEs · Mathematics 2026-03-05 Joao Miguel Machado

As the problem of minimizing functionals on the Wasserstein space encompasses many applications in machine learning, different optimization algorithms on $\mathbb{R}^d$ have received their counterpart analog on the Wasserstein space. We…

Optimization and Control · Mathematics 2024-11-20 Clément Bonet , Théo Uscidda , Adam David , Pierre-Cyril Aubin-Frankowski , Anna Korba

We perform numerical analysis of a nonlinear gradient flow, which can be regarded as a parabolic minimal surface problem or a regularised total variation flow, using the gradient discretisation method (GDM). GDM is a unified convergence…

Numerical Analysis · Mathematics 2026-04-21 Jerome Droniou , Kim-Ngan Le , Huateng Zhu

A recurring obstacle in the study of Wasserstein gradient flow is the lack of convexity of the square Wasserstein metric. In this paper, we develop a class of transport metrics that have better convexity properties and use these metrics to…

Analysis of PDEs · Mathematics 2014-06-06 Katy Craig

Wasserstein gradient flow has emerged as a promising approach to solve optimization problems over the space of probability distributions. A recent trend is to use the well-known JKO scheme in combination with input convex neural networks to…

Machine Learning · Computer Science 2022-07-26 Jiaojiao Fan , Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

We consider a general optimal control problem in the setting of gradient flows. Two approximations of the problem are presented, both relying on the variational reformulation of gradient-flow dynamics via the Weighted-Energy-Dissipation…

Optimization and Control · Mathematics 2024-03-25 Takeshi Fukao , Ulisse Stefanelli , Riccardo Voso

We study the discretization of generalized Wasserstein distances with nonlinear mobilities on the real line via suitable discrete metrics on the cone of N ordered particles, a setting which naturally appears in the framework of…

Analysis of PDEs · Mathematics 2022-09-01 Simone Di Marino , Lorenzo Portinale , Emanuela Radici

We propose a variational form of the BDF2 method as an alternative to the commonly used minimizing movement scheme for the time-discrete approximation of gradient flows in abstract metric spaces. Assuming uniform semi-convexity --- but no…

Analysis of PDEs · Mathematics 2017-12-25 Daniel Matthes , Simon Plazotta

Many machine learning problems can be seen as approximating a \textit{target} distribution using a \textit{particle} distribution by minimizing their statistical discrepancy. Wasserstein Gradient Flow can move particles along a path that…

Machine Learning · Statistics 2024-06-07 Song Liu , Jiahao Yu , Jack Simons , Mingxuan Yi , Mark Beaumont

This paper presents a novel algorithm that leverages Stochastic Gradient Descent strategies in conjunction with Random Features to augment the scalability of Conic Particle Gradient Descent (CPGD) specifically tailored for solving sparse…

Optimization and Control · Mathematics 2025-09-05 Yohann De Castro , Sébastien Gadat , Clément Marteau

In this article, we formulate topology optimization problems concerning the mass distribution as minimization problems for functionals on the Wasserstein space. We relax optimization problems regarding non-convex objective functions on the…

Optimization and Control · Mathematics 2026-01-22 Fumiya Okazaki , Takayuki Yamada