English
Related papers

Related papers: A scalable system for primal-dual optimization

200 papers

Distributed supply-chain optimization demands algorithms that can cope with unreliable communication, unbounded messaging delays, and geographically dispersed agents while still guaranteeing convergence with provable rates. In this work, we…

Optimization and Control · Mathematics 2025-06-11 Laksh Patel , Neel Shanbhag

Dual averaging-type methods are widely used in industrial machine learning applications due to their ability to promoting solution structure (e.g., sparsity) efficiently. In this paper, we propose a novel accelerated dual-averaging…

Optimization and Control · Mathematics 2020-01-17 Conghui Tan , Yuqiu Qian , Shiqian Ma , Tong Zhang

Optimal Transport (OT) naturally arises in many machine learning applications, yet the heavy computational burden limits its wide-spread uses. To address the scalability issue, we propose an implicit generative learning-based framework…

Machine Learning · Computer Science 2019-06-26 Yujia Xie , Minshuo Chen , Haoming Jiang , Tuo Zhao , Hongyuan Zha

We study online scheduling problems on a single processor that can be viewed as extensions of the well-studied problem of minimizing total weighted flow time. In particular, we provide a framework of analysis that is derived by duality…

Data Structures and Algorithms · Computer Science 2021-01-08 Spyros Angelopoulos , Giorgio Lucarelli , Nguyen Kim Thang

In this work we propose a new primal-dual algorithm with adaptive step-sizes. The stochastic primal-dual hybrid gradient (SPDHG) algorithm with constant step-sizes has become widely applied in large-scale convex optimization across many…

Optimization and Control · Mathematics 2023-12-05 Antonin Chambolle , Claire Delplancke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Junqi Tang

In this paper, we focus on solving an important class of nonconvex optimization problems which includes many problems for example signal processing over a networked multi-agent system and distributed learning over networks. Motivated by…

Optimization and Control · Mathematics 2018-10-25 Ehsan Kazemi , Liqiang Wang

The primal-dual interior point method (IPM) is widely regarded as the most efficient IPM variant for linear optimization. In this paper, we demonstrate that the improved stability of the pure primal IPM can allow speedups relative to a…

Optimization and Control · Mathematics 2024-11-26 Wenzhi Gao , Huikang Liu , Yinyu Ye , Madeleine Udell

In many operations management problems, we need to make decisions sequentially to minimize the cost while satisfying certain constraints. One modeling approach to study such problems is constrained Markov decision process (CMDP). When…

Optimization and Control · Mathematics 2021-01-27 Yi Chen , Jing Dong , Zhaoran Wang

This paper has two results. The first is based on the surprising observation that the well-known ``least-recently-used'' paging algorithm and the ``balance'' algorithm for weighted caching are linear-programming primal-dual algorithms. This…

Data Structures and Algorithms · Computer Science 2015-06-02 Neal E. Young

In this work, we consider methods for solving large-scale optimization problems with a possibly nonsmooth objective function. The key idea is to first specify a class of optimization algorithms using a generic iterative scheme involving…

Optimization and Control · Mathematics 2020-02-19 Sebastian Banert , Axel Ringh , Jonas Adler , Johan Karlsson , Ozan Öktem

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which enables flexible…

Machine Learning · Statistics 2015-11-24 Zhanxing Zhu , Amos J. Storkey

We study huge-scale assortment optimization problems to maximize expected revenue under customer choice, addressing a fundamental challenge in industries such as transportation, retail, and healthcare. The choice-based linear programming…

Optimization and Control · Mathematics 2026-02-27 Donghao Zhu , Hanzhang Qin , Ching-pei Lee , Yuki Saito , Takahiro Kawashima , Kenji Fukumizu

In this paper, we propose a primal-dual splitting algorithm for a broad class of structured composite monotone inclusions that involve finitely many set-valued operators, compositions of set-valued operators with bounded linear operators,…

Optimization and Control · Mathematics 2026-05-14 Minh N. Dao , Hung M. Phan , Matthew K. Tam , Thang D. Truong

We investigate the convergence of the primal-dual algorithm for composite optimization problems when the objective functions are weakly convex. We introduce a modified duality gap function, which is a lower bound of the standard duality gap…

Optimization and Control · Mathematics 2024-10-29 Ewa Bednarczuk , The Hung Tran , Monika Syga

We consider the decentralized convex optimization problem, where multiple agents must cooperatively minimize a cumulative objective function, with each local function expressible as an empirical average of data-dependent losses.…

Optimization and Control · Mathematics 2020-12-15 Ketan Rajawat , Chirag Kumar

This thesis focuses on Bayesian optimization with the improvements coming from two aspects:(i) the use of derivative information to accelerate the optimization convergence; and (ii) the consideration of scalable GPs for handling massive…

Machine Learning · Computer Science 2024-12-09 Ang Yang

In this paper we consider a distributed optimization scenario in which a set of processors aims at minimizing the maximum of a collection of "separable convex functions" subject to local constraints. This set-up is motivated by peak-demand…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-27 Ivano Notarnicola , Mauro Franceschelli , Giuseppe Notarstefano

This note is concerned with the problem of minimizing a separable, convex, composite (smooth and nonsmooth) function subject to linear constraints. We study a randomized block-coordinate interpretation of the Chambolle-Pock primal-dual…

Optimization and Control · Mathematics 2024-08-30 Olivier Bilenne

Supported by the recent contributions in multiple branches, the first-order splitting algorithms became central for structured nonsmooth optimization. In the large-scale or noisy contexts, when only stochastic information on the smooth part…

Optimization and Control · Mathematics 2020-10-05 Andrei Patrascu , Paul Irofti

Recently, due to rapid development of information and communication technologies, the data are created and consumed in the avalanche way. Distributed computing create preconditions for analyzing and processing such Big Data by distributing…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-30 Vladyslav Taran , Oleg Alienin , Sergii Stirenko , A. Rojbi , Yuri Gordienko