English
Related papers

Related papers: A primal-dual hybrid gradient method for non-linea…

200 papers

The primal--dual hybrid gradient method (PDHGM, also known as the Chambolle--Pock method) has proved very successful for convex optimization problems involving linear operators arising in image processing and inverse problems. In this…

Optimization and Control · Mathematics 2019-04-01 Christian Clason , Stanislav Mazurenko , Tuomo Valkonen

We propose an unconstrained optimization method based on the well-known primal-dual hybrid gradient (PDHG) algorithm. We first formulate the optimality condition of the unconstrained optimization problem as a saddle point problem. We then…

Optimization and Control · Mathematics 2024-08-29 X. Zuo , S. Osher , W. Li

This paper deals with the analysis of a recent reformulation of the primal-dual hybrid gradient method [Zhu and Chan 2008, Pock, Cremers, Bischof and Chambolle 2009, Esser, Zhang and Chan 2010, Chambolle and Pock 2011], which allows to…

Numerical Analysis · Mathematics 2014-07-08 Thomas Möllenhoff , Evgeny Strekalovskiy , Michael Moeller , Daniel Cremers

The linear primal-dual hybrid gradient (PDHG) method is a first-order method that splits convex optimization problems with saddle-point structure into smaller subproblems. Unlike those obtained in most splitting methods, these subproblems…

Optimization and Control · Mathematics 2022-04-05 Jérôme Darbon , Gabriel P. Langlois

The Stochastic Primal-Dual Hybrid Gradient (SPDHG) was proposed by Chambolle et al. (2018) and is an efficient algorithm to solve some nonsmooth large-scale optimization problems. In this paper we prove its almost sure convergence for…

Optimization and Control · Mathematics 2021-04-02 Eric B. Gutierrez , Claire Delplancke , Matthias J. Ehrhardt

In this paper, we consider optimizing a smooth, convex, lower semicontinuous function in Riemannian space with constraints. To solve the problem, we first convert it to a dual problem and then propose a general primal-dual algorithm to…

Machine Learning · Computer Science 2020-05-20 Shijun Wang , Baocheng Zhu , Lintao Ma , Yuan Qi

The primal-dual hybrid gradient (PDHG) algorithm is popular in solving min-max problems which are being widely used in a variety of areas. To improve the applicability and efficiency of PDHG for different application scenarios, we focus on…

Optimization and Control · Mathematics 2023-01-10 Yumin Ma , Xingju Cai , Bo Jiang , Deren Han

Stochastic Primal-Dual Hybrid Gradient (SPDHG) is an algorithm proposed by Chambolle et al. (2018) to efficiently solve a wide class of nonsmooth large-scale optimization problems. In this paper we contribute to its theoretical foundations…

Optimization and Control · Mathematics 2023-11-27 Eric B Gutierrez , Claire Delplancke , Matthias J Ehrhardt

Primal-dual hybrid gradient method (PDHG, a.k.a. Chambolle and Pock method) is a well-studied algorithm for minimax optimization problems with a bilinear interaction term. Recently, PDHG is used as the base algorithm for a new LP solver…

Optimization and Control · Mathematics 2023-03-14 Haihao Lu , Jinwen Yang

We develop block structure adapted primal-dual algorithms for non-convex non-smooth optimisation problems whose objectives can be written as compositions $G(x)+F(K(x))$ of non-smooth block-separable convex functions $G$ and $F$ with a…

Optimization and Control · Mathematics 2020-09-25 Stanislav Mazurenko , Jyrki Jauhiainen , Tuomo Valkonen

We design accelerated algorithms with improved rates for several fundamental classes of optimization problems. Our algorithms all build upon techniques related to the analysis of primal-dual extragradient methods via relative Lipschitzness…

Optimization and Control · Mathematics 2022-02-10 Yujia Jin , Aaron Sidford , Kevin Tian

We are presenting a modification of the well-known Alternating Direction Method of Multipliers (ADMM) algorithm with additional preconditioning that aims at solving convex optimisation problems with nonlinear operator constraints.…

Numerical Analysis · Mathematics 2020-02-13 Martin Benning , Florian Knoll , Carola-Bibiane Schönlieb , Tuomo Valkonen

Primal-dual hybrid gradient (PDHG) is a first-order method for saddle-point problems and convex programming introduced by Chambolle and Pock. Recently, Applegate et al.\ analyzed the behavior of PDHG when applied to an infeasible or…

Optimization and Control · Mathematics 2023-09-27 Tao Jiang , Walaa M. Moursi , Stephen A. Vavasis

We propose an easy-to-implement iterative method for resolving the implicit (or semi-implicit) schemes arising in solving reaction-diffusion (RD) type equations. We formulate the nonlinear time implicit scheme as a min-max saddle point…

Numerical Analysis · Mathematics 2023-05-09 Shu Liu , Siting Liu , Stanley Osher , Wuchen Li

The primal-dual hybrid gradient (PDHG) algorithm for solving convex optimization problems that arise in tomographic imaging is revisited. In particular, simplification of the selection of step-size parameters is developed for optimization…

Optimization and Control · Mathematics 2026-04-28 Emil Y. Sidky , John Paul Phillips , Zheng Zhang , Dan Xia , Ingrid S. Reiser , Xiaochuan Pan

We analyze a recently proposed class of algorithms for the problem of sampling from probability distributions $\mu^\ast$ in $\mathbb{R}^d$ with a Lebesgue density of the form $\mu^\ast(x) \propto \exp(-f(Kx)-g(x))$, where $K$ is a linear…

Optimization and Control · Mathematics 2024-11-06 Martin Burger , Matthias J. Ehrhardt , Lorenz Kuger , Lukas Weigand

The primal-dual hybrid gradient method (PDHG) is useful for optimization problems that commonly appear in image reconstruction. A downside of PDHG is that there are typically three user-set parameters and performance of the algorithm is…

Optimization and Control · Mathematics 2025-03-25 Alex McManus , Stephen Becker , Nicholas Dwork

Dual first-order methods are powerful techniques for large-scale convex optimization. Although an extensive research effort has been devoted to studying their convergence properties, explicit convergence rates for the primal iterates have…

Optimization and Control · Mathematics 2015-02-24 Jie Lu , Mikael Johansson

We provide new insight into a {\em generalized conditional subgradient} algorithm and a {\em generalized mirror descent} algorithm for the convex minimization problem \[ \min_x \; \{f(Ax) + h(x)\}.\] As Bach showed in [{\em SIAM J. Optim.},…

Optimization and Control · Mathematics 2019-06-04 Javier Pena

This paper addresses the bilinearly coupled minimax optimization problem: $\min_{x \in \mathbb{R}^{d_x}}\max_{y \in \mathbb{R}^{d_y}} \ f_1(x) + f_2(x) + y^{\top} Bx - g_1(y) - g_2(y)$, where $f_1$ and $g_1$ are smooth convex functions,…

Optimization and Control · Mathematics 2025-05-27 Jingwang Li , Xiao Li
‹ Prev 1 2 3 10 Next ›