English
Related papers

Related papers: A Unified Primal-Dual Recipe for Accelerating Thre…

200 papers

This work presents a new three-operator splitting method to handle monotone inclusion and convex optimization problems. The proposed splitting serves as another natural extension of the Douglas-Rachford splitting technique to problems…

Optimization and Control · Mathematics 2025-10-03 Anshika Anshika , Jiaxing Li , Debdas Ghosh , Xiangxiong Zhang

The Chambolle--Pock method is a versatile three-parameter algorithm designed to solve a broad class of composite convex optimization problems, which encompass two proper, lower semicontinuous, and convex functions, along with a linear…

Optimization and Control · Mathematics 2025-10-29 Sebastian Banert , Manu Upadhyaya , Pontus Giselsson

Motivated by an inertial primal-dual dynamical system with vanishing damping, we propose a class of accelerated augmented Lagrangian methods with Nesterov extrapolation parameters for a linearly constrained convex optimization problem with…

Optimization and Control · Mathematics 2026-05-28 Xin He , Nan-Jing Huang , Yi-Bin Xiao , Ya-Ping Fang

We consider the problem of minimizing a convex, separable, nonsmooth function subject to linear constraints. The numerical method we propose is a block-coordinate extension of the Chambolle-Pock primal-dual algorithm. We prove convergence…

Optimization and Control · Mathematics 2020-03-26 D. Russell Luke , Yura Malitsky

We describe convergence acceleration schemes for multistep optimization algorithms. The extrapolated solution is written as a nonlinear average of the iterates produced by the original optimization method. Our analysis does not need the…

Optimization and Control · Mathematics 2019-10-18 Raghu Bollapragada , Damien Scieur , Alexandre d'Aspremont

We introduce a novel primal-dual flow for affine constrained convex optimization problems. As a modification of the standard saddle-point system, our primal-dual flow is proved to possess the exponential decay property, in terms of a…

Optimization and Control · Mathematics 2022-03-22 Hao Luo

We analyze several generic proximal splitting algorithms well suited for large-scale convex nonsmooth optimization. We derive sublinear and linear convergence results with new rates on the function value suboptimality or distance to the…

Optimization and Control · Mathematics 2022-01-28 Laurent Condat , Grigory Malinovsky , Peter Richtárik

We propose and analyse primal-dual interior-point algorithms for convex optimization problems in conic form. The families of algorithms we analyse are so-called short-step algorithms and they match the current best iteration complexity…

Optimization and Control · Mathematics 2014-11-11 Tor Myklebust , Levent Tunçel

We demonstrate that difficult non-convex non-smooth optimization problems, such as Nash equilibrium problems and anisotropic as well as isotropic Potts segmentation model, can be written in terms of generalized conjugates of convex…

Optimization and Control · Mathematics 2021-08-27 Christian Clason , Stanislav Mazurenko , Tuomo Valkonen

The primal--dual hybrid gradient method (PDHGM, also known as the Chambolle--Pock method) has proved very successful for convex optimization problems involving linear operators arising in image processing and inverse problems. In this…

Optimization and Control · Mathematics 2019-04-01 Christian Clason , Stanislav Mazurenko , Tuomo Valkonen

We consider strongly-convex-strongly-concave saddle-point problems with general non-bilinear objective and different condition numbers with respect to the primal and the dual variables. First, we consider such problems with smooth composite…

Optimization and Control · Mathematics 2021-06-15 Vladislav Tominin , Yaroslav Tominin , Ekaterina Borodich , Dmitry Kovalev , Alexander Gasnikov , Pavel Dvurechensky

We investigate the convergence properties of a stochastic primal-dual splitting algorithm for solving structured monotone inclusions involving the sum of a cocoercive operator and a composite monotone operator. The proposed method is the…

Optimization and Control · Mathematics 2016-02-26 Lorenzo Rosasco , Silvia Villa , Bang Cong Vu

The forward-backward operator splitting algorithm is one of the most important methods for solving the optimization problem of the sum of two convex functions, where one is differentiable with a Lipschitz continuous gradient and the other…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

In this work, we study resolvent splitting algorithms for solving composite monotone inclusion problems. The objective of these general problems is finding a zero in the sum of maximally monotone operators composed with linear operators.…

Optimization and Control · Mathematics 2022-02-22 Francisco J. Aragón-Artacho , Radu I. Boţ , David Torregrosa-Belén

Primal-dual splitting involving proximity operators in order to be able to find some approximation to the minimizer for a general form of Tikhonov type functional is in the focus of this work. This approximation is produced by a pair of…

Numerical Analysis · Mathematics 2019-03-19 Erdem Altuntac

This paper develops a continuous-time primal-dual accelerated method with an increasing damping coefficient for a class of convex optimization problems with affine equality constraints. This paper analyzes critical values for parameters in…

Optimization and Control · Mathematics 2022-02-16 Xianlin Zeng , Jinlong Lei , Jie Chen

This paper introduces a unified framework for accelerated gradient methods through the variable and operator splitting (VOS). The operator splitting decouples the optimization process into simpler subproblems, and more importantly, the…

Optimization and Control · Mathematics 2025-05-08 Long Chen , Luo Hao , Jingrong Wei

Primal-dual algorithm (PDA) is a classic and popular scheme for convex-concave saddle point problems. It is universally acknowledged that the proximal terms in the subproblems about the primal and dual variables are crucial to the…

Optimization and Control · Mathematics 2025-04-24 Shuning Liu , Zexian Liu

Primal-dual algorithms are frequently used for iteratively solving large-scale convex optimization problems. The analysis of such algorithms is usually done on a case-by-case basis, and the resulting guaranteed rates of convergence can be…

Optimization and Control · Mathematics 2023-09-21 Bryan Van Scoy , John W. Simpson-Porco , Laurent Lessard

Convex nonsmooth optimization problems, whose solutions live in very high dimensional spaces, have become ubiquitous. To solve them, the class of first-order algorithms known as proximal splitting algorithms is particularly adequate: they…

Optimization and Control · Mathematics 2023-02-27 Laurent Condat , Daichi Kitahara , Andrés Contreras , Akira Hirabayashi