English
Related papers

Related papers: Enhanced PDHG for Linear Programming with Online P…

200 papers

Learning-augmented algorithms have emerged as a powerful paradigm to surpass traditional worst-case lower bounds by integrating potentially noisy predictions. While this framework has seen success in online scheduling, existing work…

Machine Learning · Computer Science 2026-05-25 Mugen Blue , Sungjin Im , Alexander Lindermayr

A natural optimization model that formulates many online resource allocation and revenue management problems is the online linear program (LP) in which the constraint matrix is revealed column by column along with the corresponding…

Data Structures and Algorithms · Computer Science 2014-04-10 Shipra Agrawal , Zizhuo Wang , Yinyu Ye

We describe a framework for deriving and analyzing online optimization algorithms that incorporate adaptive, data-dependent regularization, also termed preconditioning. Such algorithms have been proven useful in stochastic optimization by…

Machine Learning · Computer Science 2017-06-21 Vineet Gupta , Tomer Koren , Yoram Singer

The Preconditioned Conjugate Gradient (PCG) method is widely used for solving linear systems of equations with sparse matrices. A recent version of PCG, Pipelined PCG, eliminates the dependencies in the computations of the PCG algorithm so…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-14 Manasi Tiwari , Sathish Vadhiyar

While linear programming (LP) decoding provides more flexibility for finite-length performance analysis than iterative message-passing (IMP) decoding, it is computationally more complex to implement in its original form, due to both the…

Information Theory · Computer Science 2009-02-05 Mohammad H. Taghavi , Amin Shokrollahi , Paul H. Siegel

In this work we propose a new primal-dual algorithm with adaptive step-sizes. The stochastic primal-dual hybrid gradient (SPDHG) algorithm with constant step-sizes has become widely applied in large-scale convex optimization across many…

Optimization and Control · Mathematics 2023-12-05 Antonin Chambolle , Claire Delplancke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Junqi Tang

We consider solving huge-scale instances of (convex) conic linear optimization problems, at the scale where matrix-factorization-free methods are attractive or necessary. The restarted primal-dual hybrid gradient method (rPDHG) -- with…

Optimization and Control · Mathematics 2024-07-16 Zikai Xiong , Robert M. Freund

In this paper, we address the efficient numerical solution of linear and quadratic programming problems, often of large scale. With this aim, we devise an infeasible interior point method, blended with the proximal method of multipliers,…

Numerical Analysis · Mathematics 2021-01-18 Luca Bergamaschi , Jacek Gondzio , Ángeles Martínez , John W. Pearson , Spyridon Pougkakiotis

We consider a multi-agent consensus optimization problem over a server-client (federated) network, where all clients are connected to a central server. Current distributed algorithms fail to capture the heterogeneity in clients' local…

Optimization and Control · Mathematics 2023-08-02 Xiaochun Niu , Ermin Wei

Online feedback-based optimization has become a promising framework for real-time optimization and control of complex engineering systems. This tutorial paper surveys the recent advances in the field as well as provides novel convergence…

Optimization and Control · Mathematics 2023-09-07 Andrey Bernstein , Joshua Comden , Yue Chen , Jing Wang

We consider the setting of distributed empirical risk minimization where multiple machines compute the gradients in parallel and a centralized server updates the model parameters. In order to reduce the number of communications required to…

Optimization and Control · Mathematics 2020-02-26 Hadrien Hendrikx , Lin Xiao , Sebastien Bubeck , Francis Bach , Laurent Massoulie

In this paper, we consider a Model Predictive Control (MPC) problem of a continuous-time linear time-invariant system subject to continuous-time path constraints on the states and the inputs. By leveraging the concept of differential…

Optimization and Control · Mathematics 2023-04-19 Zishuo Li , Bo Yang , Jiayun Li , Jiaqi Yan , Yilin Mo

This paper addresses the design and analysis of feedback-based online algorithms to control systems or networked systems based on performance objectives and engineering constraints that may evolve over time. The emerging time-varying convex…

Optimization and Control · Mathematics 2019-03-27 Andrey Bernstein , Emiliano Dall'Anese , Andrea Simonetto

Primal-dual algorithms for the resolution of convex-concave saddle point problems usually come with one or several step size parameters. Within the range where convergence is guaranteed, choosing well the step size can make the difference…

Optimization and Control · Mathematics 2024-03-29 Olivier Fercoq

In this paper we propose to use model reduction techniques for speeding up the diagonalization-based parallel-in-time (ParaDIAG) preconditioner, for iteratively solving all-at-once systems from evolutionary PDEs. In particular, we use the…

Numerical Analysis · Mathematics 2020-12-17 Jun Liu , Zhu Wang

We are presenting a modification of the well-known Alternating Direction Method of Multipliers (ADMM) algorithm with additional preconditioning that aims at solving convex optimisation problems with nonlinear operator constraints.…

Numerical Analysis · Mathematics 2020-02-13 Martin Benning , Florian Knoll , Carola-Bibiane Schönlieb , Tuomo Valkonen

We incorporate future information in the form of the estimated value of future gradients in online convex optimization. This is motivated by demand response in power systems, where forecasts about the current round, e.g., the weather or the…

Optimization and Control · Mathematics 2020-12-14 Antoine Lesage-Landry , Iman Shames , Joshua A. Taylor

Factor-revealing linear programs (LPs) and policy-revealing LPs arise in various contexts of algorithm design and analysis. They are commonly used techniques for analyzing the performance of approximation and online algorithms, especially…

Data Structures and Algorithms · Computer Science 2025-03-20 Pan Xu

Data-driven acceleration of scientific computing workflows has been a high-profile aim of machine learning (ML) for science, with numerical simulation of transient partial differential equations (PDEs) being one of the main applications.…

Computational Physics · Physics 2025-12-05 Mikhail Khodak , Min Ki Jung , Brian Wynne , Edmond Chow , Egemen Kolemen

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

Optimization and Control · Mathematics 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang