English
Related papers

Related papers: An Overview of GPU-based First-Order Methods for L…

200 papers

In this paper, we introduce a practical GPU-enhanced matrix-free first-order method for solving large-scale conic programming problems, which we refer to as PDCS, standing for the Primal-Dual Conic Programming Solver. Problems that it…

Optimization and Control · Mathematics 2026-04-03 Zhenwei Lin , Zikai Xiong , Dongdong Ge , Yinyu Ye

Convex quadratic programming (QP) is an essential class of optimization problems with broad applications across various fields. Traditional QP solvers, typically based on simplex or barrier methods, face significant scalability challenges.…

Optimization and Control · Mathematics 2024-10-08 Yicheng Huang , Wanyu Zhang , Hongpei Li , Dongdong Ge , Huikang Liu , Yinyu Ye

Various first order approaches have been proposed in the literature to solve Linear Programming (LP) problems, recently leading to practically efficient solvers for large-scale LPs. From a theoretical perspective, linear convergence rates…

Optimization and Control · Mathematics 2024-03-29 Richard Cole , Christoph Hertrich , Yixin Tao , László A. Végh

Large-scale linear programs (LPs) arise in many decision systems, including ranking, allocation, and matching problems that must be solved repeatedly at massive scale. Prior work such as ECLIPSE and LinkedIn's open-source DuaLip showed that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-06 Gregory Dexter , Aida Rahmattalabi , Sanjana Garg , Qinquan Song , Ruby Tu , Yuan Gao , Yi Zhang , Zhipeng Wang , Rahul Mazumder

This work presents a GPU-accelerated solver for the unit commitment (UC) problem in large-scale power grids. The solver uses the Primal-Dual Hybrid Gradient (PDHG) algorithm to efficiently solve the relaxed linear subproblem, achieving…

Optimization and Control · Mathematics 2025-12-09 Hussein Sharadga , Javad Mohammadi

The exponential growth of computational workloads is surpassing the capabilities of conventional architectures, which are constrained by fundamental limits. In-memory computing (IMC) with RRAM provides a promising alternative by providing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-09 Huynh Q. N. Vo , Md Tawsif Rahman Chowdhury , Paritosh Ramanan , Gozde Tutuncuoglu , Junchi Yang , Feng Qiu , Murat Yildirim

In recent years, GPU-accelerated optimization solvers based on second-order methods (e.g., interior-point methods) have gained momentum with the advent of mature and efficient GPU-accelerated direct sparse linear solvers, such as cuDSS.…

Optimization and Control · Mathematics 2025-11-25 Alexis Montoison , François Pacaud , Sungho Shin , Mihai Anitescu

First-order methods for solving convex optimization problems have been at the forefront of mathematical optimization in the last 20 years. The rapid development of this important class of algorithms is motivated by the success stories…

Optimization and Control · Mathematics 2021-01-07 Pavel Dvurechensky , Mathias Staudigl , Shimrit Shtern

We consider solving huge-scale instances of (convex) conic linear optimization problems, at the scale where matrix-factorization-free methods are attractive or necessary. The restarted primal-dual hybrid gradient method (rPDHG) -- with…

Optimization and Control · Mathematics 2024-07-16 Zikai Xiong , Robert M. Freund

This paper introduces cuHALLaR, a GPU-accelerated implementation of the HALLaR method proposed in Monteiro et al. 2024 for solving large-scale semidefinite programming (SDP) problems. We demonstrate how our Julia-based implementation…

Solving large-scale linear programming (LP) problems is an important task in various areas such as communication networks, power systems, finance and logistics. Recently, two distinct approaches have emerged to expedite LP solving: (i)…

Machine Learning · Computer Science 2024-06-07 Bingheng Li , Linxin Yang , Yupeng Chen , Senmiao Wang , Qian Chen , Haitao Mao , Yao Ma , Akang Wang , Tian Ding , Jiliang Tang , Ruoyu Sun

The primal-dual hybrid gradient method (PDHG) is useful for optimization problems that commonly appear in image reconstruction. A downside of PDHG is that there are typically three user-set parameters and performance of the algorithm is…

Optimization and Control · Mathematics 2025-03-25 Alex McManus , Stephen Becker , Nicholas Dwork

Linear programming is the seminal optimization problem that has spawned and grown into today's rich and diverse optimization modeling and algorithmic landscape. This article provides an overview of the recent development of first-order…

Optimization and Control · Mathematics 2024-03-22 Haihao Lu

Motivated by large-scale applications, there is a recent trend of research on using first-order methods for solving LP. Among them, PDLP, which is based on a primal-dual hybrid gradient (PDHG) algorithm, may be the most promising one. In…

Optimization and Control · Mathematics 2026-04-08 Tianhao Liu , Haihao Lu

We investigate the use of low-precision first-order methods (FOMs) within a fix-and-propagate (FP) framework for solving mixed-integer programming problems (MIPs). We employ GPU-accelerated PDLP, a variant of the Primal-Dual Hybrid Gradient…

Optimization and Control · Mathematics 2026-03-05 Nils-Christian Kempke , Thorsten Koch

Primal-Dual Hybrid Gradient (PDHG) and Alternating Direction Method of Multipliers (ADMM) are two widely-used first-order optimization methods. They reduce a difficult problem to simple subproblems, so they are easy to implement and have…

Optimization and Control · Mathematics 2019-09-10 Yanli Liu , Yunbei Xu , Wotao Yin

Large-scale competitive market equilibrium problems arise in a wide range of important applications, including economic decision-making and intelligent manufacturing. Traditional solution methods, such as interior-point algorithms and…

Optimization and Control · Mathematics 2025-06-09 Huikang Liu , Yicheng Huang , Hongpei Li , Dongdong Ge , Yinyu Ye

We propose an unconstrained optimization method based on the well-known primal-dual hybrid gradient (PDHG) algorithm. We first formulate the optimality condition of the unconstrained optimization problem as a saddle point problem. We then…

Optimization and Control · Mathematics 2024-08-29 X. Zuo , S. Osher , W. Li

Security-Constrained Unit Commitment is a fundamental optimization problem in power systems operations. The primary computational bottleneck arises from the need to solve large-scale Linear Programming (LP) relaxations within…

Optimization and Control · Mathematics 2025-10-14 Jinxin Xiong , Yanting Huang , Yingxiao Wang , Linxin Yang , Jianghua Wu , Shunbo Lei , Akang Wang

This paper presents a hybrid CPU-GPU framework for solving combinatorial scheduling problems formulated as Integer Linear Programming (ILP). While scheduling underpins many optimization tasks in computing systems, solving these problems…

Machine Learning · Computer Science 2026-04-01 Mingju Liu , Jiaqi Yin , Alvaro Velasquez , Cunxi Yu