English
Related papers

Related papers: Atomic Gradient Flows: Gradient Flows on Sparse Re…

200 papers

This paper introduces a novel theoretical framework and a suite of highly efficient, parallelizable algorithms for solving the large-scale multicommodity flow (MCF) feasibility problem. We reframe the classical constraint-satisfaction…

Optimization and Control · Mathematics 2025-08-26 Pengfei Liu

We present a robust optimisation framework for computing invariant solutions of wall-bounded flows by recasting the Navier-Stokes equations as a variational problem as established in Ashtari and Schneider, JFM (2023). The approach minimises…

Fluid Dynamics · Physics 2026-04-14 Thomas Burton , Sean Symon , Davide Lasagna

The scarcity of labeled data is a long-standing challenge for many machine learning tasks. We propose our gradient flow method to leverage the existing dataset (i.e., source) to generate new samples that are close to the dataset of interest…

Machine Learning · Computer Science 2023-11-06 Xinru Hua , Truyen Nguyen , Tam Le , Jose Blanchet , Viet Anh Nguyen

Particle-based variational inference (VI) minimizes the KL divergence between model samples and the target posterior with gradient flow estimates. With the popularity of Stein variational gradient descent (SVGD), the focus of particle-based…

Machine Learning · Statistics 2023-04-19 Hanze Dong , Xi Wang , Yong Lin , Tong Zhang

Generalized eigenvalue problems (GEPs) find applications in various fields of science and engineering. For example, principal component analysis, Fisher's discriminant analysis, and canonical correlation analysis are specific instances of…

Machine Learning · Computer Science 2024-11-05 Zhaoqiang Liu , Wen Li , Junren Chen

We consider decentralized gradient-free optimization of minimizing Lipschitz continuous functions that satisfy neither smoothness nor convexity assumption. We propose two novel gradient-free algorithms, the Decentralized Gradient-Free…

Optimization and Control · Mathematics 2025-01-29 Zhenwei Lin , Jingfan Xia , Qi Deng , Luo Luo

We propose novel algorithms combining accelerated gradient flows with linearized projection-free treatments of non-convex constraints and BDF pseudo-temporal discretization for quadratic energy minimization. A general framework is developed…

Numerical Analysis · Mathematics 2025-06-13 Guozhi Dong , Zikang Gong , Ziqing Xie , Shuo Yang

The Projected Gradient Descent (PGD) algorithm is a widely used and efficient first-order method for solving constrained optimization problems due to its simplicity and scalability in large design spaces. Building on recent advancements in…

Optimization and Control · Mathematics 2025-06-18 Lucka Barbeau , Marc-Étienne Lamarche-Gagnon , Florin Ilinca

We study a system of drift-diffusion PDEs for a potentially infinite number of incompressible phases, subject to a joint pointwise volume constraint. Our analysis is based on the interpretation as a collection of coupled Wasserstein…

Analysis of PDEs · Mathematics 2024-11-22 Clément Cancès , Daniel Matthes , Ismael Medina , Bernhard Schmitzer

We consider a class of optimization problems on the space of probability measures motivated by the mean-field approach to studying neural networks. Such problems can be solved by constructing continuous-time gradient flows that converge to…

Optimization and Control · Mathematics 2026-02-18 Petra Lazić , Linshan Liu , Mateusz B. Majka

We study the momentum-based minimization of a diffuse perimeter functional on Euclidean spaces and on graphs with applications to semi-supervised classification tasks in machine learning. While the gradient flow in the task at hand is a…

Analysis of PDEs · Mathematics 2025-06-26 Oluwatosin Akande , Patrick Dondl , Kanan Gupta , Akwum Onwunta , Stephan Wojtowytsch

We consider the gradient flow structure of the porous medium equations with non-negative constant Dirichlet boundary conditions. We construct weak solutions to the equations via the minimizing movement scheme by considering an entropy…

Analysis of PDEs · Mathematics 2025-05-30 Dongkwang Kim , Dowan Koo , Geuntaek Seo

We explicitly construct parameter transformations between gradient flows in metric spaces, called curves of maximal slope, having different exponents when the associated function satisfies a suitable convexity condition. These…

Analysis of PDEs · Mathematics 2024-04-04 Sho Shimoyama

A popular method to perform adversarial attacks on neuronal networks is the so-called fast gradient sign method and its iterative variant. In this paper, we interpret this method as an explicit Euler discretization of a differential…

Machine Learning · Computer Science 2025-09-17 Lukas Weigand , Tim Roith , Martin Burger

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

The Wasserstein barycenter extends the Euclidean mean to the space of probability measures by minimizing the weighted sum of squared 2-Wasserstein distances. We develop a free-support algorithm for computing Wasserstein barycenters that…

Machine Learning · Statistics 2025-09-17 Kisung You

This manuscript introduces a regression-type formulation for approximating the Perron-Frobenius Operator by relying on distributional snapshots of data. These snapshots may represent densities of particles. The Wasserstein metric is…

Optimization and Control · Mathematics 2020-11-03 Amirhossein Karimi , Tryphon T. Georgiou

We develop a geometric convergence theory for neural-network optimization within the minimizing movement scheme (MMS) framework. Reformulating each neural MMS step as a minimization over the set of increments in a Hilbert space, we show…

Optimization and Control · Mathematics 2026-05-28 Shixin Zheng , Yiwei Wang , Haizhao Yang

As a counterpoint to recent numerical methods for crystal surface evolution, which agree well with microscopic dynamics but suffer from significant stiffness that prevents simulation on fine spatial grids, we develop a new numerical method…

Numerical Analysis · Mathematics 2020-06-24 Katy Craig , Jian-Guo Liu , Jianfeng Lu , Jeremy L. Marzuola , Li Wang

We formulate well-posed continuous-time generative flows for learning distributions that are supported on low-dimensional manifolds through Wasserstein proximal regularizations of $f$-divergences. Wasserstein-1 proximal operators regularize…

Machine Learning · Statistics 2024-07-17 Hyemin Gu , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang