English
Related papers

Related papers: Atomic Gradient Flows: Gradient Flows on Sparse Re…

200 papers

Many tasks in machine learning and signal processing can be solved by minimizing a convex function of a measure. This includes sparse spikes deconvolution or training a neural network with a single hidden layer. For these problems, we study…

Optimization and Control · Mathematics 2018-10-30 Lenaic Chizat , Francis Bach

We develop a fast and scalable numerical approach to solve Wasserstein gradient flows (WGFs), particularly suitable for high-dimensional cases. Our approach is to use general reduced-order models, like deep neural networks, to parameterize…

Numerical Analysis · Mathematics 2024-05-24 Yijie Jin , Shu Liu , Hao Wu , Xiaojing Ye , Haomin Zhou

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

For addressing optimisation tasks on finite dimensional quantum systems, we give a comprehensive account of the foundations of gradient flows on Riemannian manifolds including new developments: we extend former results from Lie groups such…

Quantum Physics · Physics 2010-12-07 T. Schulte-Herbrueggen , S. J. Glaser , G. Dirr , U. Helmke

This paper studies minimax optimization problems defined over infinite-dimensional function classes of overparameterized two-layer neural networks. In particular, we consider the minimax optimization problem stemming from estimating linear…

Machine Learning · Computer Science 2024-10-25 Yuchen Zhu , Yufeng Zhang , Zhaoran Wang , Zhuoran Yang , Xiaohong Chen

Wasserstein gradient flow (WGF) is a common method to perform optimization over the space of probability measures. While WGF is guaranteed to converge to a first-order stationary point, for nonconvex functionals the converged solution does…

Optimization and Control · Mathematics 2025-09-23 Naoya Yamamoto , Juno Kim , Taiji Suzuki

Gradient-flow (GF) viewpoints unify and illuminate optimization algorithms, yet most GF analyses focus on unconstrained settings. We develop a geometry-respecting framework for constrained problems by (i) reparameterizing feasible sets with…

Optimization and Control · Mathematics 2025-08-29 Valentin Leplat

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Machine Learning · Computer Science 2026-05-22 Arthur Gretton , Li Kevin Wenliang , Alexandre Galashov , James Thornton , Valentin De Bortoli , Arnaud Doucet

This is an expository paper on the theory of gradient flows, and in particular of those PDEs which can be interpreted as gradient flows for the Wasserstein metric on the space of probability measures (a distance induced by optimal…

Analysis of PDEs · Mathematics 2016-09-14 Filippo Santambrogio

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

Optimization and Control · Mathematics 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

In this study, we investigate the performance of two novel first-order optimization algorithms, namely the rescaled-gradient flow (RGF) and the signed-gradient flow (SGF). These algorithms are derived from the forward Euler discretization…

Machine Learning · Computer Science 2025-03-19 Siqi Zhang , Mouhacine Benosman , Orlando Romero

Parametric manifold optimization problems frequently arise in various machine learning tasks, where state functions are defined on infinite-dimensional manifolds. We propose a unified accelerated natural gradient descent (ANGD) framework to…

Optimization and Control · Mathematics 2025-04-09 Chenyi Li , Shuchen Zhu , Zhonglin Xie , Zaiwen Wen

This paper studies stochastic control problems with the action space taken to be probability measures, with the objective penalised by the relative entropy. We identify suitable metric space on which we construct a gradient flow for the…

Optimization and Control · Mathematics 2024-01-26 David Šiška , Łukasz Szpruch

Gradient descent-ascent (GDA) flows play a central role in finding saddle points of bivariate functionals, with applications in optimization, game theory, and robust control. While they are well-understood in Hilbert and Banach spaces via…

Functional Analysis · Mathematics 2025-06-26 Noboru Isobe , Sho Shimoyama

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

This paper contains two contributions in the study of optimal transport on metric graphs. Firstly, we prove a Benamou-Brenier formula for the Wasserstein distance, which establishes the equivalence of static and dynamical optimal transport.…

Analysis of PDEs · Mathematics 2022-05-02 Matthias Erbar , Dominik Forkert , Jan Maas , Delio Mugnolo

Solving Fredholm equations of the first kind is crucial in many areas of the applied sciences. In this work we adopt a probabilistic and variational point of view by considering a minimization problem in the space of probability measures…

Optimization and Control · Mathematics 2024-05-17 Francesca R. Crucinio , Valentin De Bortoli , Arnaud Doucet , Adam M. Johansen

The $E$-optimality criterion for a regression model maximizes the smallest eigenvalue of the information matrix and becomes non-differentiable when this eigenvalue has multiplicity greater than one. Working in the $2$-Wasserstein space, we…

Optimization and Control · Mathematics 2026-04-17 Jieling Shi , Kim-Chuan Toh , Xin T. Tong , Weng Kee Wong

We study a variant of the dynamical optimal transport problem in which the energy to be minimised is modulated by the covariance matrix of the distribution. Such transport metrics arise naturally in mean-field limits of certain ensemble…

Analysis of PDEs · Mathematics 2024-12-23 Martin Burger , Matthias Erbar , Franca Hoffmann , Daniel Matthes , André Schlichting

This paper proposes novel gradient-flow schemes that yield convergence to the optimal point of a convex optimization problem within a \textit{fixed} time from any given initial condition for unconstrained optimization, constrained…

Optimization and Control · Mathematics 2022-04-27 Kunal Garg , Dimitra Panagou
‹ Prev 1 2 3 10 Next ›