English
Related papers

Related papers: Efficient Primal-dual Forward-backward Splitting M…

200 papers

This paper studies the primal-dual convergence and iteration-complexity of proximal bundle methods for solving nonsmooth problems with convex structures. More specifically, we develop a family of primal-dual proximal bundle methods for…

Optimization and Control · Mathematics 2025-09-26 Jiaming Liang

We prove the equivalence between the notion of Wasserstein gradient flow for a one-dimensional nonlocal transport PDE with attractive/repulsive Newtonian potential on one side, and the notion of entropy solution of a Burgers-type scalar…

Analysis of PDEs · Mathematics 2013-10-16 Giovanni A. Bonaschi , José A. Carrillo , Marco Di Francesco , Mark A. Peletier

We introduce a new sequential subspace optimization method for large-scale saddle-point problems. It solves iteratively a sequence of auxiliary saddle-point problems in low-dimensional subspaces, spanned by directions derived from…

Optimization and Control · Mathematics 2020-08-24 Yoni Choukroun , Michael Zibulevsky , Pavel Kisilev

Efficient trajectory generation is crucial for autonomous systems; however, current numerical methods often struggle to handle periodic behaviors effectively, particularly when the onboard sensors require equidistant temporal sampling. This…

Systems and Control · Electrical Eng. & Systems 2026-01-16 Liraz Mudrik , Sean Kragelund , Isaac Kaminer

We propose a novel dynamically weighted inertial forward-backward algorithm (DWIFOB) for solving structured monotone inclusion problems. The scheme exploits the globally convergent forward-backward algorithm with deviations in [26] as the…

Optimization and Control · Mathematics 2022-03-02 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

Optimization and Control · Mathematics 2026-05-28 Tam Le

We present a novel approach to approximate Gaussian and mixture-of-Gaussians filtering. Our method relies on a variational approximation via a gradient-flow representation. The gradient flow is derived from a Kullback--Leibler discrepancy…

Computation · Statistics 2023-06-21 Adrien Corenflos , Hany Abdulsamad

This article is concerned with the existence and the long time behavior of weak solutions to certain coupled systems of fourth-order degenerate parabolic equations of gradient flow type. The underlying metric is a Wasserstein-like…

Analysis of PDEs · Mathematics 2016-09-23 Daniel Matthes , Jonathan Zinsl

We propose an easy-to-implement iterative method for resolving the implicit (or semi-implicit) schemes arising in solving reaction-diffusion (RD) type equations. We formulate the nonlinear time implicit scheme as a min-max saddle point…

Numerical Analysis · Mathematics 2023-05-09 Shu Liu , Siting Liu , Stanley Osher , Wuchen Li

In this paper, we introduce a dynamical urban planning model. This leads us to study a system of nonlinear equations coupled through multi-marginal optimal transport problems. A simple case consists in solving two equations coupled through…

Analysis of PDEs · Mathematics 2018-05-04 Maxime Laborde

Non-negative matrix and tensor factorisations are a classical tool for finding low-dimensional representations of high-dimensional datasets. In applications such as imaging, datasets can be regarded as distributions supported on a space…

Machine Learning · Statistics 2021-07-16 Stephen Y. Zhang

We develop a progressive training approach for neural networks which adaptively grows the network structure by splitting existing neurons to multiple off-springs. By leveraging a functional steepest descent idea, we derive a simple…

Machine Learning · Computer Science 2019-11-06 Qiang Liu , Lemeng Wu , Dilin Wang

This paper introduces a novel approach for the construction of bulk--surface splitting schemes for semi-linear parabolic partial differential equations with dynamic boundary conditions. The proposed construction is based on a reformulation…

Numerical Analysis · Mathematics 2023-07-06 R. Altmann , C. Zimmer

We propose a primal-dual smoothing framework for finding a near-stationary point of a class of non-smooth non-convex optimization problems with max-structure. We analyze the primal and dual gradient complexities of the framework via two…

Optimization and Control · Mathematics 2023-07-19 Renbo Zhao

We develop in this paper an adaptive time-stepping approach for gradient flows with distinct treatments for conservative and non-conservative dynamics. For the non-conservative gradient flows in Lagrangian coordinates, we propose a modified…

Numerical Analysis · Mathematics 2025-04-21 Qianqian Liu , Wenbin Chen , Jie Shen , Qing Cheng

The Wasserstein metric or earth mover's distance (EMD) is a useful tool in statistics, machine learning and computer science with many applications to biological or medical imaging, among others. Especially in the light of increasingly…

Optimization and Control · Mathematics 2018-01-26 Jörn Schrieber , Dominic Schuhmacher , Carsten Gottschlich

Wasserstein gradient flows provide a powerful means of understanding and solving many diffusion equations. Specifically, Fokker-Planck equations, which model the diffusion of probability measures, can be understood as gradient descent over…

Machine Learning · Computer Science 2021-10-26 Petr Mokrov , Alexander Korotin , Lingxiao Li , Aude Genevay , Justin Solomon , Evgeny Burnaev

The paper considers distributed gradient flow (DGF) for multi-agent nonconvex optimization. DGF is a continuous-time approximation of distributed gradient descent that is often easier to study than its discrete-time counterpart. The paper…

Optimization and Control · Mathematics 2020-08-13 Brian Swenson , Ryan Murray , H. Vincent Poor , Soummya Kar

We consider the problem of optimal path planning on a manifold which is the image of a smooth function. Optimal path-planning is of crucial importance for motion planning, image processing, and statistical data analysis. In this work, we…

Optimization and Control · Mathematics 2024-12-19 Edward Huynh , Christian Parkinson

This paper shows that a perturbed form of gradient descent converges to a second-order stationary point in a number iterations which depends only poly-logarithmically on dimension (i.e., it is almost "dimension-free"). The convergence rate…

Machine Learning · Computer Science 2017-03-03 Chi Jin , Rong Ge , Praneeth Netrapalli , Sham M. Kakade , Michael I. Jordan