English
Related papers

Related papers: A geometrically converging dual method for distrib…

200 papers

In this paper, we consider the problem of distributed consensus optimization over multi-agent networks with directed network topology. Assuming each agent has a local cost function that is smooth and strongly convex, the global objective is…

Optimization and Control · Mathematics 2020-08-21 Shi Pu

Distributed optimization is ubiquitous in emerging applications, such as robust sensor network control, smart grid management, machine learning, resource slicing, and localization. However, the extensive data exchange among local and…

This paper examines online distributed Alternating Direction Method of Multipliers (ADMM). The goal is to distributively optimize a global objective function over a network of decision makers under linear constraints. The global objective…

Optimization and Control · Mathematics 2015-10-05 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

This paper considers the decision-dependent optimization problem, where the data distributions react in response to decisions affecting both the objective function and linear constraints. We propose a new method termed repeated projected…

Optimization and Control · Mathematics 2025-08-13 Zifan Wang , Changxin Liu , Thomas Parisini , Michael M. Zavlanos , Karl H. Johansson

We introduce the Projected Push-Pull algorithm that enables multiple agents to solve a distributed constrained optimization problem with private cost functions and global constraints, in a collaborative manner. Our algorithm employs…

Optimization and Control · Mathematics 2023-10-11 Orhan Eren Akgün , Arif Kerem Dayı , Stephanie Gil , Angelia Nedić

In this paper we develop random block coordinate gradient descent methods for minimizing large scale linearly constrained separable convex problems over networks. Since we have coupled constraints in the problem, we devise an algorithm that…

Optimization and Control · Mathematics 2015-12-14 I. Necoara , Yu. Nesterov , F. Glineur

In this paper we propose a distributed dual gradient algorithm for minimizing linearly constrained separable convex problems and analyze its rate of convergence. In particular, we prove that under the assumption of strong convexity and…

Optimization and Control · Mathematics 2014-10-01 Ion Necoara , Valentin Nedelcu

Various distributed optimization methods have been developed for solving problems which have simple local constraint sets and whose objective function is the sum of local cost functions of distributed agents in a network. Motivated by…

Systems and Control · Computer Science 2016-11-17 Tsung-Hui Chang , Angelia Nedić , Anna Scaglione

We formulate an optimization problem for maximizing the data rate of a common message transmitted from nodes within an airborne network broadcast to a central station receiver while maintaining a set of intra-network rate demands. Assuming…

Optimization and Control · Mathematics 2017-06-08 Theodoros Tsiligkaridis

We consider the decentralized optimization problem, where a network of $n$ agents aims to collaboratively minimize the average of their individual smooth and convex objective functions through peer-to-peer communication in a directed graph.…

Optimization and Control · Mathematics 2023-12-07 Zhuoqing Song , Lei Shi , Shi Pu , Ming Yan

This paper considers a general data-fitting problem over a networked system, in which many computing nodes are connected by an undirected graph. This kind of problem can find many real-world applications and has been studied extensively in…

Machine Learning · Computer Science 2017-04-14 Ying Zhang

In this paper, we propose GT-GDA, a distributed optimization method to solve saddle point problems of the form: $\min_{\mathbf{x}} \max_{\mathbf{y}} \{F(\mathbf{x},\mathbf{y}) :=G(\mathbf{x}) + \langle \mathbf{y}, \overline{P} \mathbf{x}…

Optimization and Control · Mathematics 2022-07-04 Muhammad I. Qureshi , Usman A. Khan

This paper considers a convex optimization problem with cost and constraints that evolve over time. The function to be minimized is strongly convex and possibly non-differentiable, and variables are coupled through linear constraints. In…

Systems and Control · Electrical Eng. & Systems 2021-01-13 Yijian Zhang , Emiliano Dall'Anese , Mingyi Hong

We consider convex and nonconvex constrained optimization with a partially separable objective function: agents minimize the sum of local objective functions, each of which is known only by the associated agent and depends on the variables…

Optimization and Control · Mathematics 2020-10-20 Loris Cannelli , Francisco Facchinei , Gesualdo Scutari , Vyacheslav Kungurtsev

We develop a new randomized iterative algorithm---stochastic dual ascent (SDA)---for finding the projection of a given vector onto the solution space of a linear system. The method is dual in nature: with the dual being a non-strongly…

Numerical Analysis · Mathematics 2016-01-29 Robert Mansel Gower , Peter Richtarik

In this work, we revisit a classical incremental implementation of the primal-descent dual-ascent gradient method used for the solution of equality constrained optimization problems. We provide a short proof that establishes the linear…

Optimization and Control · Mathematics 2020-01-17 Sulaiman A. Alghunaim , Ali H. Sayed

Decentralized optimization strategies are helpful for various applications, from networked estimation to distributed machine learning. This paper studies finite-sum minimization problems described over a network of nodes and proposes a…

Systems and Control · Electrical Eng. & Systems 2024-08-06 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

We study the distributed stochastic compositional optimization problems over directed communication networks in which agents privately own a stochastic compositional objective function and collaborate to minimize the sum of all objective…

Optimization and Control · Mathematics 2022-03-22 Shengchao Zhao , Yongchao Liu

We consider the problem of allocating a fixed amount of resource among nodes in a network when each node suffers a cost which is a convex function of the amount of resource allocated to it. We propose a new deterministic and distributed…

Optimization and Control · Mathematics 2016-06-14 Thinh T. Doan , Alex Olshevsky

The paper considers distributed stochastic optimization over randomly switching networks, where agents collaboratively minimize the average of all agents' local expectation-valued convex cost functions. Due to the stochasticity in gradient…

Optimization and Control · Mathematics 2022-04-07 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong