English
Related papers

Related papers: BALPA: A Balanced Primal-Dual Algorithm for Nonsmo…

200 papers

Various distributed optimization methods have been developed for solving problems which have simple local constraint sets and whose objective function is the sum of local cost functions of distributed agents in a network. Motivated by…

Systems and Control · Computer Science 2016-11-17 Tsung-Hui Chang , Angelia Nedić , Anna Scaglione

Consider the problem of minimizing the sum of two convex functions, one being smooth and the other non-smooth. In this paper, we introduce a general class of approximate proximal splitting (APS) methods for solving such minimization…

Optimization and Control · Mathematics 2014-04-23 Mojtaba Kadkhodaie , Maziar Sanjabi , Zhi-Quan Luo

Discrete stochastic optimization considers the problem of minimizing (or maximizing) loss functions defined on discrete sets, where only noisy measurements of the loss functions are available. The discrete stochastic optimization problem is…

Optimization and Control · Mathematics 2013-11-04 Qi Wang

In this paper, we develop a distributed mixing-accelerated primal-dual proximal algorithm, referred to as MAP-Pro, which enables nodes in multi-agent networks to cooperatively minimize the sum of their nonconvex, smooth local cost functions…

Optimization and Control · Mathematics 2024-03-12 Zichong Ou , Chenyang Qiu , Dandan Wang , Jie Lu

Convex nonsmooth optimization problems, whose solutions live in very high dimensional spaces, have become ubiquitous. To solve them, the class of first-order algorithms known as proximal splitting algorithms is particularly adequate: they…

Optimization and Control · Mathematics 2023-02-27 Laurent Condat , Daichi Kitahara , Andrés Contreras , Akira Hirabayashi

In this work, we introduce ADAPD, $\textbf{A}$ $\textbf{D}$ecentr$\textbf{A}$lized $\textbf{P}$rimal-$\textbf{D}$ual algorithmic framework for solving non-convex and smooth consensus optimization problems over a network of distributed…

Optimization and Control · Mathematics 2023-02-07 Gabriel Mancino-Ball , Yangyang Xu , Jie Chen

This paper addresses the problem of safe optimization under a single smooth constraint, a scenario that arises in diverse real-world applications such as robotics and autonomous navigation. The objective of safe optimization is to solve a…

Optimization and Control · Mathematics 2025-05-15 Ilnura Usmanova , Kfir Yehuda Levy

In this paper, we develop a parameterized proximal point algorithm (P-PPA) for solving a class of separable convex programming problems subject to linear and convex constraints. The proposed algorithm is provable to be globally convergent…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Hongchao Zhang , Jicheng Li

We investigate the distributed multi-agent sharing optimization problem in a directed graph, with a composite objective function consisting of a smooth function plus a convex (possibly non-smooth) function shared by all agents. While…

Optimization and Control · Mathematics 2024-06-21 Sajad Zandi , Mehdi Korki

This paper proposes a novel proximal-gradient algorithm for a decentralized optimization problem with a composite objective containing smooth and non-smooth terms. Specifically, the smooth and nonsmooth terms are dealt with by gradient and…

Optimization and Control · Mathematics 2021-02-02 Zhi Li , Wei Shi , Ming Yan

Nonconvex constrained optimization problems can be used to model a number of machine learning problems, such as multi-class Neyman-Pearson classification and constrained Markov decision processes. However, such kinds of problems are…

Optimization and Control · Mathematics 2024-12-04 Songtao Lu

Distributed optimization methods for large-scale machine learning suffer from a communication bottleneck. It is difficult to reduce this bottleneck while still efficiently and accurately aggregating partial work from different machines. In…

Machine Learning · Computer Science 2015-07-06 Chenxin Ma , Virginia Smith , Martin Jaggi , Michael I. Jordan , Peter Richtárik , Martin Takáč

In this paper, we develop a distributed algorithm for solving a class of distributed convex optimization problems where the local objective functions can be a general nonsmooth function, and all equalities and inequalities are network-wide…

Optimization and Control · Mathematics 2026-04-14 Yeong-Ung Kim , Hyo-Sung Ahn

In this paper we consider a general, challenging distributed optimization set-up arising in several important network control applications. Agents of a network want to minimize the sum of local cost functions, each one depending on a local…

Systems and Control · Computer Science 2018-06-15 Ivano Notarnicola , Giuseppe Notarstefano

The paper studies a distributed constrained optimization problem, where multiple agents connected in a network collectively minimize the sum of individual objective functions subject to a global constraint being an intersection of the local…

Optimization and Control · Mathematics 2016-03-08 Jinlong Lei , Han-Fu Chen , Hai-Tao Fang

This paper is devoted to the design of efficient primal-dual algorithm (PDA) for solving convex optimization problems with known saddle-point structure. We present a new PDA with larger acceptable range of parameters and correction, which…

Optimization and Control · Mathematics 2019-12-04 Xiaokai Chang , Sanyang Liu

We study a continuous-time primal-dual algorithm for distributed optimization with nonconvex local cost functions over weight-unbalanced digraphs, and analyze its performance from a dissipativity-based perspective. We first reformulate the…

Optimization and Control · Mathematics 2026-02-10 Weijian Li , Panos J. Antsaklis , Hai Lin

We analyze several generic proximal splitting algorithms well suited for large-scale convex nonsmooth optimization. We derive sublinear and linear convergence results with new rates on the function value suboptimality or distance to the…

Optimization and Control · Mathematics 2022-01-28 Laurent Condat , Grigory Malinovsky , Peter Richtárik

This work proposes and studies the distributed resource allocation problem in asynchronous and stochastic settings. We consider a distributed system with multiple workers and a coordinating server with heterogeneous computation and…

Optimization and Control · Mathematics 2025-09-03 Qiang Li , Michal Yemini , Hoi-To Wai

Distributed supply-chain optimization demands algorithms that can cope with unreliable communication, unbounded messaging delays, and geographically dispersed agents while still guaranteeing convergence with provable rates. In this work, we…

Optimization and Control · Mathematics 2025-06-11 Laksh Patel , Neel Shanbhag