English
Related papers

Related papers: On the Geometry and Refined Rate of Primal-Dual Hy…

200 papers

The primal-dual hybrid gradient (PDHG) algorithm is popular in solving min-max problems which are being widely used in a variety of areas. To improve the applicability and efficiency of PDHG for different application scenarios, we focus on…

Optimization and Control · Mathematics 2023-01-10 Yumin Ma , Xingju Cai , Bo Jiang , Deren Han

Primal-dual algorithms for the resolution of convex-concave saddle point problems usually come with one or several step size parameters. Within the range where convergence is guaranteed, choosing well the step size can make the difference…

Optimization and Control · Mathematics 2024-03-29 Olivier Fercoq

Convex quadratic programming (QP) is an essential class of optimization problems with broad applications across various fields. Traditional QP solvers, typically based on simplex or barrier methods, face significant scalability challenges.…

Optimization and Control · Mathematics 2024-10-08 Yicheng Huang , Wanyu Zhang , Hongpei Li , Dongdong Ge , Huikang Liu , Yinyu Ye

The Primal-Dual Hybrid Gradient (PDHG) algorithm is a first-order method that can exploit GPUs to solve large-scale linear programming problems. The approach can often be faster than the alternatives, simplex and interior-point methods,…

Optimization and Control · Mathematics 2026-03-04 Edward Rothberg

We consider solving huge-scale instances of (convex) conic linear optimization problems, at the scale where matrix-factorization-free methods are attractive or necessary. The restarted primal-dual hybrid gradient method (rPDHG) -- with…

Optimization and Control · Mathematics 2024-07-16 Zikai Xiong , Robert M. Freund

We propose two variants of the Primal Dual Hybrid Gradient (PDHG) algorithm for saddle point problems with block decomposable duals, hereafter called Multi-Timescale PDHG (MT-PDHG) and its accelerated variant (AMT-PDHG). Through novel…

Optimization and Control · Mathematics 2026-04-03 Junhui Zhang , Patrick Jaillet

We study the problem of detecting infeasibility of large-scale linear programming problems using the primal-dual hybrid gradient method (PDHG) of Chambolle and Pock (2011). The literature on PDHG has mostly focused on settings where the…

Optimization and Control · Mathematics 2021-02-10 David Applegate , Mateo Díaz , Haihao Lu , Miles Lubin

We propose a scalable preconditioned primal-dual hybrid gradient algorithm for solving partial differential equations (PDEs). We multiply the PDE with a dual test function to obtain an inf-sup problem whose loss functional involves…

Numerical Analysis · Mathematics 2026-05-26 Shu Liu , Stanley Osher , Wuchen Li

First-order primal-dual methods are appealing for their low memory overhead, fast iterations, and effective parallelization. However, they are often slow at finding high accuracy solutions, which creates a barrier to their use in…

Optimization and Control · Mathematics 2023-12-05 David Applegate , Oliver Hinder , Haihao Lu , Miles Lubin

Primal-dual hybrid gradient (PDHG) is a first-order method for saddle-point problems and convex programming introduced by Chambolle and Pock. Recently, Applegate et al.\ analyzed the behavior of PDHG when applied to an infeasible or…

Optimization and Control · Mathematics 2023-09-27 Tao Jiang , Walaa M. Moursi , Stephen A. Vavasis

The least absolute shrinkage and selection operator (Lasso) is widely recognized across various fields of mathematics and engineering. Its variant, the generalized Lasso, finds extensive application in the fields of statistics, machine…

Optimization and Control · Mathematics 2024-03-22 Bowen Li , Bin Shi

As a counterpoint to recent numerical methods for crystal surface evolution, which agree well with microscopic dynamics but suffer from significant stiffness that prevents simulation on fine spatial grids, we develop a new numerical method…

Numerical Analysis · Mathematics 2020-06-24 Katy Craig , Jian-Guo Liu , Jianfeng Lu , Jeremy L. Marzuola , Li Wang

Solving large-scale linear programming (LP) problems is an important task in various areas such as communication networks, power systems, finance and logistics. Recently, two distinct approaches have emerged to expedite LP solving: (i)…

Machine Learning · Computer Science 2024-06-07 Bingheng Li , Linxin Yang , Yupeng Chen , Senmiao Wang , Qian Chen , Haitao Mao , Yao Ma , Akang Wang , Tian Ding , Jiliang Tang , Ruoyu Sun

The primal--dual hybrid gradient method (PDHGM, also known as the Chambolle--Pock method) has proved very successful for convex optimization problems involving linear operators arising in image processing and inverse problems. In this…

Optimization and Control · Mathematics 2019-04-01 Christian Clason , Stanislav Mazurenko , Tuomo Valkonen

The generalized Lasso is a remarkably versatile and extensively utilized model across a broad spectrum of domains, including statistics, machine learning, and image science. Among the optimization techniques employed to address the…

Optimization and Control · Mathematics 2024-07-29 Xueying Zeng , Bin Shi

We propose an easy-to-implement iterative method for resolving the implicit (or semi-implicit) schemes arising in solving reaction-diffusion (RD) type equations. We formulate the nonlinear time implicit scheme as a min-max saddle point…

Numerical Analysis · Mathematics 2023-05-09 Shu Liu , Siting Liu , Stanley Osher , Wuchen Li

In this work we propose a new primal-dual algorithm with adaptive step-sizes. The stochastic primal-dual hybrid gradient (SPDHG) algorithm with constant step-sizes has become widely applied in large-scale convex optimization across many…

Optimization and Control · Mathematics 2023-12-05 Antonin Chambolle , Claire Delplancke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Junqi Tang

Convex quadratic programming (QP) is an important class of optimization problem with wide applications in practice. The classic QP solvers are based on either simplex or barrier method, both of which suffer from the scalability issue…

Optimization and Control · Mathematics 2025-07-16 Haihao Lu , Jinwen Yang

We study a block-structured class of convex-concave saddle-point problems in which both the primal and dual variables admit natural separable decompositions. Motivated by large-scale applications where a full update on either side can be…

Optimization and Control · Mathematics 2026-05-19 Yiheng Xiao , Huikang Liu

The primal-dual hybrid gradient (PDHG) algorithm for solving convex optimization problems that arise in tomographic imaging is revisited. In particular, simplification of the selection of step-size parameters is developed for optimization…

Optimization and Control · Mathematics 2026-04-28 Emil Y. Sidky , John Paul Phillips , Zheng Zhang , Dan Xia , Ingrid S. Reiser , Xiaochuan Pan