中文
相关论文

相关论文: A Decentralized Primal-Dual Method with Quasi-Newt…

200 篇论文

We consider decentralized optimization problems in which a number of agents collaborate to minimize the average of their local functions by exchanging over an underlying communication graph. Specifically, we place ourselves in an…

最优化与控制 · 数学 2023-03-20 Yu-Guan Hsieh , Yassine Laguel , Franck Iutzeler , Jérôme Malick

We study distributed optimization to minimize a global objective that is a sum of smooth and strongly-convex local cost functions. Recently, several algorithms over undirected and directed graphs have been proposed that use a gradient…

最优化与控制 · 数学 2018-08-13 Ran Xin , Usman A. Khan

We consider the task of minimizing the sum of smooth and strongly convex functions stored in a decentralized manner across the nodes of a communication network whose links are allowed to change in time. We solve two fundamental problems for…

最优化与控制 · 数学 2021-06-09 Dmitry Kovalev , Elnur Gasanov , Peter Richtárik , Alexander Gasnikov

We consider the decentralized optimization problem, where a network of $n$ agents aims to collaboratively minimize the average of their individual smooth and convex objective functions through peer-to-peer communication in a directed graph.…

最优化与控制 · 数学 2023-12-07 Zhuoqing Song , Lei Shi , Shi Pu , Ming Yan

We propose a new first-order primal-dual optimization framework for a convex optimization template with broad applications. Our optimization algorithms feature optimal convergence guarantees under a variety of common structure assumptions…

最优化与控制 · 数学 2018-02-23 Quoc Tran-Dinh , Olivier Fercoq , Volkan Cevher

This paper develops a distributed model predictive control (DMPC) strategy for a class of discrete-time linear systems with consideration of globally coupled constraints. The DMPC under study is based on the dual problem concerning all…

最优化与控制 · 数学 2019-07-25 Yanxu Su , Yang Shi , Changyin Sun

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

We propose a primal-dual interior-point (PDIP) method for solving quadratic programming problems with linear inequality constraints that typically arise form MPC applications. We show that the solver converges (locally) quadratically to a…

最优化与控制 · 数学 2017-09-20 X. Zhang , L. Ferranti , T. Keviczky

When the data is distributed across multiple servers, lowering the communication cost between the servers (or workers) while solving the distributed learning problem is an important problem and is the focus of this paper. In particular, we…

机器学习 · 计算机科学 2020-03-25 Anis Elgabli , Jihong Park , Amrit S. Bedi , Mehdi Bennis , Vaneet Aggarwal

This paper develops a distributed primal-dual algorithm via event-triggered mechanism to solve a class of convex optimization problems subject to local set constraints, coupled equality and inequality constraints. Different from some…

最优化与控制 · 数学 2022-10-27 Yi Huang , Xianlin Zeng , Ziyang Meng , Jian Sun

Decentralized optimization is well studied for smooth unconstrained problems. However, constrained problems or problems with composite terms are an open direction for research. We study structured (or composite) optimization problems, where…

最优化与控制 · 数学 2023-04-10 Alexander Rogozin , Anton Novitskii , Alexander Gasnikov

This paper considers decentralized consensus optimization problems where different summands of a global objective function are available at nodes of a network that can communicate with neighbors only. The proximal method of multipliers is…

最优化与控制 · 数学 2016-02-02 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

In a multi-agent network, we consider the problem of minimizing an objective function that is expressed as the sum of private convex and smooth functions, and a (possibly) non-differentiable convex regularizer. We propose a novel…

最优化与控制 · 数学 2021-09-30 Yichuan Li , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

In decentralized consensus optimization, a connected network of agents collaboratively minimize the sum of their local objective functions over a common decision variable, where their information exchange is restricted between the…

最优化与控制 · 数学 2015-06-16 Wei Shi , Qing Ling , Kun Yuan , Gang Wu , Wotao Yin

The paper studies decentralized optimization over networks, where agents minimize a composite objective consisting of the sum of smooth convex functions--the agents' losses--and an additional nonsmooth convex extended value function. We…

最优化与控制 · 数学 2025-08-05 Xiaokai Chen , Ilya Kuruzov , Gesualdo Scutari , Alexander Gasnikov

In this paper, we introduce a novel iterative algorithm for the problem of phase-retrieval where the measurements consist of only the magnitude of linear function of the unknown signal, and the noise in the measurements follow Poisson…

信号处理 · 电气工程与系统科学 2022-04-06 Ghania Fatima , Zongyu Li , Aakash Arora , Prabhu Babu

We propose a new randomized coordinate descent method for a convex optimization template with broad applications. Our analysis relies on a novel combination of four ideas applied to the primal-dual gap function: smoothing, acceleration,…

最优化与控制 · 数学 2017-11-10 Ahmet Alacaoglu , Quoc Tran-Dinh , Olivier Fercoq , Volkan Cevher

In this paper, we propose a quasi-Newton method for solving smooth and monotone nonlinear equations, including unconstrained minimization and minimax optimization as special cases. For the strongly monotone setting, we establish two global…

最优化与控制 · 数学 2024-10-04 Ruichen Jiang , Aryan Mokhtari

We introduce a randomly extrapolated primal-dual coordinate descent method that adapts to sparsity of the data matrix and the favorable structures of the objective function. Our method updates only a subset of primal and dual variables with…

最优化与控制 · 数学 2020-07-14 Ahmet Alacaoglu , Olivier Fercoq , Volkan Cevher

The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of $n$ local cost functions by using local information exchange is considered. This problem is an important component of many machine…

最优化与控制 · 数学 2022-01-11 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson