English
Related papers

Related papers: Accessible Complexity Bounds for Restarted PDHG on…

200 papers

We study the computational complexity of the infinite-horizon discounted-reward Markov Decision Problem (MDP) with a finite state space $|\mathcal{S}|$ and a finite action space $|\mathcal{A}|$. We show that any randomized algorithm needs a…

Computational Complexity · Computer Science 2017-05-24 Yichen Chen , Mengdi Wang

Fault tolerance is a major concern in distributed computational settings. In the classic master-worker setting, a server (the master) needs to perform some heavy computation which it may distribute to $m$ other machines (workers) in order…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-30 Keren Censor-Hillel , Yuka Machino , Pedro Soto

The optimistic gradient method has seen increasing popularity for solving convex-concave saddle point problems. To analyze its iteration complexity, a recent work [arXiv:1906.01115] proposed an interesting perspective that interprets this…

Optimization and Control · Mathematics 2024-01-11 Ruichen Jiang , Aryan Mokhtari

This paper proposes and analyzes a dampened proximal alternating direction method of multipliers (DP.ADMM) for solving linearly-constrained nonconvex optimization problems where the smooth part of the objective function is nonseparable.…

Optimization and Control · Mathematics 2023-01-05 Weiwei Kong , Renato D. C. Monteiro

We give a lower bound on the iteration complexity of a natural class of Lagrangean-relaxation algorithms for approximately solving packing/covering linear programs. We show that, given an input with $m$ random 0/1-constraints on $n$…

Data Structures and Algorithms · Computer Science 2015-11-23 Phil Klein , Neal E. Young

This paper presents an algorithmic study and complexity analysis for solving distributionally robust multistage convex optimization (DR-MCO). We generalize the usual consecutive dual dynamic programming (DDP) algorithm to DR-MCO and propose…

Optimization and Control · Mathematics 2024-01-05 Shixuan Zhang , Xu Andy Sun

In this paper, we are concerned with a worst-case complexity analysis of a-posteriori algorithms for unconstrained multiobjective optimization. Specifically, we propose an algorithmic framework that generates sets of points by means of…

Optimization and Control · Mathematics 2025-06-16 Andrea Cristofari , Marianna De Santis , Stefano Lucidi , Giampaolo Liuzzi

We present the Anderson Accelerated Primal-Dual Hybrid Gradient (AA-PDHG), a fixed-point-based framework designed to overcome the slow convergence of the standard PDHG method for the solution of linear programming (LP) problems. We…

Optimization and Control · Mathematics 2025-08-12 Yingxin Zhou , Stefano Cipolla , Phan Tu Vuong

Motivated, in particular, by the entropy-regularized optimal transport problem, we consider convex optimization problems with linear equality constraints, where the dual objective has Lipschitz $p$-th order derivatives, and develop two…

Optimization and Control · Mathematics 2023-08-11 Pavel Dvurechensky , Petr Ostroukhov , Alexander Gasnikov , César A. Uribe , Anastasiya Ivanova

Transforming into an exact penalty function model with convex compact constraints yields efficient infeasible approaches for optimization problems with orthogonality constraints. For smooth and $\ell_{2,1}$-norm regularized cases, these…

Optimization and Control · Mathematics 2021-10-06 Nachuan Xiao , Xin Liu , Ya-xiang Yuan

Recent studies have shown that proximal gradient (PG) method and accelerated gradient method (APG) with restarting can enjoy a linear convergence under a weaker condition than strong convexity, namely a quadratic growth condition (QGC).…

Optimization and Control · Mathematics 2017-05-16 Mingrui Liu , Tianbao Yang

We present an online preconditioning technique for the primal-dual hybrid gradient (PDHG) algorithm for linear programming (LP). The method adaptively updates primal and dual preconditioners using an online optimization framework. To…

Optimization and Control · Mathematics 2025-06-24 Haihao Lu , Wanyu Zhang

We study fundamental block-structured integer programs called tree-fold and multi-stage IPs. Tree-fold IPs admit a constraint matrix with independent blocks linked together by few constraints in a recursive pattern; and transposing their…

Computational Complexity · Computer Science 2024-02-28 Christoph Hunkenschröder , Kim-Manuel Klein , Martin Koutecký , Alexandra Lassota , Asaf Levin

Linear programming (LP) is an extremely useful tool and has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2020-03-19 Agniva Chowdhury , Palma London , Haim Avron , Petros Drineas

Raghavendra (STOC 2008) gave an elegant and surprising result: if Khot's Unique Games Conjecture (STOC 2002) is true, then for every constraint satisfaction problem (CSP), the best approximation ratio is attained by a certain simple…

Data Structures and Algorithms · Computer Science 2010-11-01 Yuichi Yoshida

In the \emph {barrier resilience} problem (introduced by Kumar {\em et al.}, Wireless Networks 2007), we are given a collection of regions of the plane, acting as obstacles, and we would like to remove the minimum number of regions so that…

Computational Complexity · Computer Science 2017-06-07 Matias Korman , Maarten Löffler , Rodrigo I. Silveira , Darren Strash

Popular machine learning estimators involve regularization parameters that can be challenging to tune, and standard strategies rely on grid search for this task. In this paper, we revisit the techniques of approximating the regularization…

Machine Learning · Statistics 2019-05-28 Eugene Ndiaye , Tam Le , Olivier Fercoq , Joseph Salmon , Ichiro Takeuchi

The Chambolle-Pock algorithm (CPA), also known as the primal-dual hybrid gradient method, has gained popularity over the last decade due to its success in solving large-scale convex structured problems. This work extends its convergence…

Optimization and Control · Mathematics 2025-03-11 Brecht Evens , Puya Latafat , Panagiotis Patrinos

We analyze the complexity of single-loop quadratic penalty and augmented Lagrangian algorithms for solving nonconvex optimization problems with functional equality constraints. We consider three cases, in all of which the objective is…

Optimization and Control · Mathematics 2023-11-02 Ahmet Alacaoglu , Stephen J. Wright

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson