English
Related papers

Related papers: PDHCG: A Scalable First-Order Method for Large-Sca…

200 papers

In this paper, we study saddle point (SP) problems, focusing on convex-concave optimization involving functions that satisfy either two-sided quadratic functional growth (QFG) or two-sided quadratic gradient growth (QGG)--novel conditions…

Optimization and Control · Mathematics 2025-10-15 Cody Melcher , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

We consider a class of non-smooth strongly convex-strongly concave saddle point problems in a decentralized setting without a central server. To solve a consensus formulation of problems in this class, we develop an inexact primal dual…

Machine Learning · Computer Science 2023-09-14 Chhavi Sharma , Vishnu Narayanan , P. Balamurugan

This paper presents a hybrid CPU-GPU framework for solving combinatorial scheduling problems formulated as Integer Linear Programming (ILP). While scheduling underpins many optimization tasks in computing systems, solving these problems…

Machine Learning · Computer Science 2026-04-01 Mingju Liu , Jiaqi Yin , Alvaro Velasquez , Cunxi Yu

In this paper, we study the problem of minimizing a sum of convex objective functions, which are locally available to agents in a network. Distributed optimization algorithms make it possible for the agents to cooperatively solve the…

Optimization and Control · Mathematics 2020-03-31 Fatemeh Mansoori , Ermin Wei

In this paper, we analyze the recently proposed stochastic primal-dual hybrid gradient (SPDHG) algorithm and provide new theoretical results. In particular, we prove almost sure convergence of the iterates to a solution with convexity and…

Optimization and Control · Mathematics 2022-06-23 Ahmet Alacaoglu , Olivier Fercoq , Volkan Cevher

We study huge-scale assortment optimization problems to maximize expected revenue under customer choice, addressing a fundamental challenge in industries such as transportation, retail, and healthcare. The choice-based linear programming…

Optimization and Control · Mathematics 2026-02-27 Donghao Zhu , Hanzhang Qin , Ching-pei Lee , Yuki Saito , Takahiro Kawashima , Kenji Fukumizu

Efficiently solving large-scale sparse linear systems poses a significant challenge in computational science, especially in fields such as physics, engineering, machine learning, and finance. Traditional classical algorithms face…

Quantum Physics · Physics 2024-10-04 Hakikat Singh

Hierarchical decision making problems, such as bilevel programs and Stackelberg games, are attracting increasing interest in both the engineering and machine learning communities. Yet, existing solution methods lack either convergence…

Optimization and Control · Mathematics 2024-03-29 Panagiotis D. Grontas , Giuseppe Belgioioso , Carlo Cenedese , Marta Fochesato , John Lygeros , Florian Dörfler

This paper investigates the convex optimization problem with general convex inequality constraints. To cope with this problem, a discrete-time algorithm, called augmented primal-dual gradient algorithm (Aug-PDG), is studied and analyzed. It…

Optimization and Control · Mathematics 2020-11-18 Min Meng , Xiuxian Li

This paper proposes and analyzes a tuning-free variant of Primal-Dual Hybrid Gradient (PDHG), and investigates its effectiveness for solving large-scale semidefinite programming (SDP). The core idea is based on the combination of two…

Optimization and Control · Mathematics 2024-02-02 Yinjun Wang , Haixiang Lan , Yinyu Ye

This paper studies the distributed model predictive control (DMPC) problem for distributed discrete-time linear systems with both local and global constraints over directed communication networks. We establish an optimization problem to…

Optimization and Control · Mathematics 2025-11-06 Pengbiao Wang , Xuemei Ren , Dongdong Zheng

In this paper we present the solver DuQuad specialized for solving general convex quadratic problems arising in many engineering applications. When it is difficult to project on the primal feasible set, we use the (augmented) Lagrangian…

Optimization and Control · Mathematics 2015-04-23 Ion Necoara , Andrei Patrascu

Stochastic Primal-Dual Hybrid Gradient (SPDHG) is an algorithm proposed by Chambolle et al. (2018) to efficiently solve a wide class of nonsmooth large-scale optimization problems. In this paper we contribute to its theoretical foundations…

Optimization and Control · Mathematics 2023-11-27 Eric B Gutierrez , Claire Delplancke , Matthias J Ehrhardt

Primal-dual algorithms for the resolution of convex-concave saddle point problems usually come with one or several step size parameters. Within the range where convergence is guaranteed, choosing well the step size can make the difference…

Optimization and Control · Mathematics 2024-03-29 Olivier Fercoq

The supply function equilibrium (SFE) is a model for competition in markets where each firm offers a schedule of prices and quantities to face demand uncertainty, and has been successfully applied to wholesale electricity markets. However,…

Optimization and Control · Mathematics 2015-02-05 Sheng Yu , Enrique Campos-Nanez

We consider a general class of combinatorial optimization problems including among others allocation, multiple knapsack, matching or travelling salesman problems. The standard version of those problems is the maximum weight optimization…

Data Structures and Algorithms · Computer Science 2018-01-24 Viet Hung Nguyen , Paul Weng

In this paper, we introduce a novel first-order dual gradient algorithm for solving network utility maximization problems that arise in resource allocation schemes over networks with safety-critical constraints. Inspired by applications…

Optimization and Control · Mathematics 2022-08-10 Berkay Turan , Mahnoosh Alizadeh

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

Optimization and Control · Mathematics 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson

We introduce a fusion of GPU accelerated primal heuristics for Mixed Integer Programming. Leveraging GPU acceleration enables exploration of larger search regions and faster iterations. A GPU-accelerated PDLP serves as an approximate LP…

Optimization and Control · Mathematics 2025-10-31 Akif Çördük , Piotr Sielski , Alice Boucher , Kumar Aatish

The Stochastic Primal-Dual Hybrid Gradient (SPDHG) was proposed by Chambolle et al. (2018) and is an efficient algorithm to solve some nonsmooth large-scale optimization problems. In this paper we prove its almost sure convergence for…

Optimization and Control · Mathematics 2021-04-02 Eric B. Gutierrez , Claire Delplancke , Matthias J. Ehrhardt