English
Related papers

Related papers: Variable-preconditioned transformed primal-dual me…

200 papers

Solving Fredholm equations of the first kind is crucial in many areas of the applied sciences. In this work we adopt a probabilistic and variational point of view by considering a minimization problem in the space of probability measures…

Optimization and Control · Mathematics 2024-05-17 Francesca R. Crucinio , Valentin De Bortoli , Arnaud Doucet , Adam M. Johansen

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

The Jordan-Kinderlehrer-Otto (JKO) scheme provides a stable variational framework for computing Wasserstein gradient flows, but its practical use is often limited by the high computational cost of repeatedly solving the JKO subproblems. We…

Machine Learning · Computer Science 2026-01-12 Xue Feng , Li Wang , Deanna Needell , Rongjie Lai

In this paper, we aim to accelerate a preconditioned alternating direction method of multipliers (pADMM), whose proximal terms are convex quadratic functions, for solving linearly constrained convex optimization problems. To achieve this,…

Optimization and Control · Mathematics 2024-12-10 Defeng Sun , Yancheng Yuan , Guojun Zhang , Xinyuan Zhao

We consider (stochastic) subgradient methods for strongly convex but potentially nonsmooth non-Lipschitz optimization. We provide new equivalent dual descriptions (in the style of dual averaging) for the classic subgradient method, the…

Optimization and Control · Mathematics 2024-12-31 Benjamin Grimmer , Danlin Li

Recently, Garcke et al.[Garcke, Hinze, Kahle, A stable and linear time discretization for a thermodynamically consistent model for two-phase incompressible flow, Applied Numerical Mathematics 99, pp. 151-171, 2016] developed a consistent…

Numerical Analysis · Mathematics 2017-02-16 Jessica Bosch , Christian Kahle , Martin Stoll

We consider the approximation of initial/boundary value problems involving, possibly high-dimensional, dissipative evolution partial differential equations (PDEs) using a deep neural network framework. More specifically, we first propose…

Numerical Analysis · Mathematics 2022-06-02 Emmanuil H. Georgoulis , Michail Loulakis , Asterios Tsiourvas

We develop structure preserving schemes for a class of nonlinear mobility continuity equation. When the mobility is a concave function, this equation admits a form of gradient flow with respect to a Wasserstein-like transport metric. Our…

Numerical Analysis · Mathematics 2025-10-21 Jose A. Carrillo , Li Wang , Chaozhen Wei

We study structured nonsmooth convex finite-sum optimization that appears widely in machine learning applications, including support vector machines and least absolute deviation. For the primal-dual formulation of this problem, we propose a…

Optimization and Control · Mathematics 2021-04-08 Chaobing Song , Stephen J. Wright , Jelena Diakonikolas

Implementing particle-interaction configuration and time integration are performance intensive essentials of particle-based methods. In this paper, a dual-criteria time-stepping method is proposed to improve the computational efficiency of…

Computational Physics · Physics 2020-02-28 Chi Zhang , Massoud Rezavand , Xiangyu Hu

Wasserstein gradient flow (WGF) is a common method to perform optimization over the space of probability measures. While WGF is guaranteed to converge to a first-order stationary point, for nonconvex functionals the converged solution does…

Optimization and Control · Mathematics 2025-09-23 Naoya Yamamoto , Juno Kim , Taiji Suzuki

This work introduces a novel adaptive central-upwind scheme designed for simulating compressible flows with discontinuities in the flow field. The proposed approach offers significant improvements in computational efficiency over the…

Fluid Dynamics · Physics 2024-09-05 Amareshwara Sainadh Chamarthi

In this paper, we study higher-order-accurate-in-time minimizing movements schemes for Wasserstein gradient flows. We introduce a novel accelerated second-order scheme, leveraging the differential structure of the Wasserstein space in both…

Analysis of PDEs · Mathematics 2025-12-23 Raymond Chu , Matt Jacobs

We derive finite-particle rates for the regularized Stein variational gradient descent (R-SVGD) algorithm introduced by He et al. (2024) that corrects the constant-order bias of the SVGD by applying a resolvent-type preconditioner to the…

Machine Learning · Statistics 2026-05-19 Ye He , Krishnakumar Balasubramanian , Sayan Banerjee , Promit Ghosal

We propose a variational scheme for computing Wasserstein gradient flows. The scheme builds upon the Jordan--Kinderlehrer--Otto framework with the Benamou-Brenier's dynamic formulation of the quadratic Wasserstein metric and adds a…

Numerical Analysis · Mathematics 2020-07-15 Wuchen Li , Jianfeng Lu , Li Wang

In this paper we devote our attention to a class of weighted ultrafast diffusion equations arising from the problem of quantisation for probability measures. These equations have a natural gradient flow structure in the space of probability…

Analysis of PDEs · Mathematics 2019-01-30 Mikaela Iacobelli , Francesco Patacchini , Filippo Santambrogio

We introduce an efficient first-order primal-dual method for the solution of nonsmooth PDE-constrained optimization problems. We achieve this efficiency through not solving the PDE or its linearisation on each iteration of the optimization…

Optimization and Control · Mathematics 2024-06-11 Bjørn Jensen , Tuomo Valkonen

We develop a fast and scalable numerical approach to solve Wasserstein gradient flows (WGFs), particularly suitable for high-dimensional cases. Our approach is to use general reduced-order models, like deep neural networks, to parameterize…

Numerical Analysis · Mathematics 2024-05-24 Yijie Jin , Shu Liu , Hao Wu , Xiaojing Ye , Haomin Zhou

This work presents and compares efficient implementations of high-order discontinuous Galerkin methods: a modal matrix-free discontinuous Galerkin (DG) method, a hybridizable discontinuous Galerkin (HDG) method, and a primal formulation of…

Computational Physics · Physics 2018-12-14 Matteo Franciolini , Krzysztof Fidkowski , Andrea Crivellini

Wasserstein Gradient Flow (WGF) describes the gradient dynamics of probability density within the Wasserstein space. WGF provides a promising approach for conducting optimization over the probability distributions. Numerically approximating…

Machine Learning · Computer Science 2024-06-04 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang