English
Related papers

Related papers: Distributed Stochastic Block Coordinate Descent fo…

200 papers

We consider a distributed stochastic optimization problem that is solved by a decentralized network of agents with only local communication between neighboring agents. The goal of the whole system is to minimize a global objective function…

Optimization and Control · Mathematics 2022-11-10 Alexander Rogozin , Mikhail Bochko , Pavel Dvurechensky , Alexander Gasnikov , Vladislav Lukoshkin

We propose a distributed algorithm, termed the Directed-Distributed Projected Subgradient (D-DPS), to solve a constrained optimization problem over a multi-agent network, where the goal of agents is to collectively minimize the sum of…

Optimization and Control · Mathematics 2016-08-30 Chenguang Xi , Usman A. Khan

In this paper, we focus on solving a distributed convex optimization problem in a network, where each agent has its own convex cost function and the goal is to minimize the sum of the agents' cost functions while obeying the network…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Wei Shi , Jinming Xu , Angelia Nedić

We devise a distributed asynchronous stochastic epsilon-gradient-based algorithm to enable a network of computing and communicating nodes to solve a constrained discrete-time time-varying stochastic convex optimization problem. Each node…

Optimization and Control · Mathematics 2014-10-02 Andrea Simonetto , Leon Kester , Geert Leus

This paper proposes a new framework for distributed optimization, called distributed aggregative optimization, which allows local objective functions to be dependent not only on their own decision variables, but also on the average of…

Optimization and Control · Mathematics 2020-05-28 Xiuxian Li , Lihua Xie , Yiguang Hong

In this paper, we investigate the distributed convex optimization problem over a multi-agent system with Markovian switching communication networks. The objective function is the sum of each agent's local objective function, which cannot be…

Optimization and Control · Mathematics 2020-02-25 Peng Yi , Li Li

In this paper, we consider distributed optimization problems over a multi-agent network, where each agent can only partially evaluate the objective function, and it is allowed to exchange messages with its immediate neighbors. Differently…

Optimization and Control · Mathematics 2019-02-22 Davood Hajinezhad , Mingyi Hong , Alfredo Garcia

Driven by the need to solve increasingly complex optimization problems in signal processing and machine learning, there has been increasing interest in understanding the behavior of gradient-descent algorithms in non-convex environments.…

Optimization and Control · Mathematics 2019-07-04 Stefan Vlaski , Ali H. Sayed

This paper studies distributed resource allocation problem in multi-agent systems, where all the agents cooperatively minimize the sum of their cost functions with global resource constraints over stochastic communication networks. This…

Optimization and Control · Mathematics 2021-04-27 Tie Ding , Shanying Zhu , Cailian Chen , Xinping Guan

This work develops effective distributed strategies for the solution of constrained multi-agent stochastic optimization problems with coupled parameters across the agents. In this formulation, each agent is influenced by only a subset of…

Optimization and Control · Mathematics 2019-03-15 Sulaiman A. Alghunaim , Ali H. Sayed

We consider a distributed convex optimization problem in a network which is time-varying and not always strongly connected. The local cost function of each node is affected by some stochastic process. All nodes of the network collaborate to…

Optimization and Control · Mathematics 2021-05-27 Wenjie Li , Mohamad Assaad

We consider a convex unconstrained optimization problem that arises in a network of agents whose goal is to cooperatively optimize the sum of the individual agent objective functions through local computations and communications. For this…

Optimization and Control · Mathematics 2008-03-11 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John N. Tsitsiklis

We study distributed stochastic gradient (D-SG) method and its accelerated variant (D-ASG) for solving decentralized strongly convex stochastic optimization problems where the objective function is distributed over several computational…

Optimization and Control · Mathematics 2021-10-05 Alireza Fallah , Mert Gurbuzbalaban , Asuman Ozdaglar , Umut Simsekli , Lingjiong Zhu

This paper studies the distributed optimization problem with possibly nonidentical local constraints, where its global objective function is composed of $N$ convex functions. The aim is to solve the considered optimization problem in a…

Optimization and Control · Mathematics 2022-08-26 Hongzhe Liu , Wenwu Yu , Guanghui Wen , Wei Xing Zheng

In this paper, a distributed subgradient-based algorithm is proposed for continuous-time multi-agent systems to search a feasible solution to convex inequalities. The algorithm involves each agent achieving a state constrained by its own…

Systems and Control · Computer Science 2017-06-13 Kaihong Lu , Gangshan Jing , Long Wang

We study distributed (strongly convex) optimization problems over a network of agents, with no centralized nodes. The loss functions of the agents are assumed to be \textit{similar}, due to statistical data similarity or otherwise. In order…

Optimization and Control · Mathematics 2022-04-12 Ye Tian , Gesualdo Scutari , Tianyu Cao , Alexander Gasnikov

Distributed multi-agent optimization finds many applications in distributed learning, control, estimation, etc. Most existing algorithms assume knowledge of first-order information of the objective and have been analyzed for convex…

Optimization and Control · Mathematics 2020-06-17 Yujie Tang , Junshan Zhang , Na Li

The block coordinate descent (BCD) method is widely used for minimizing a continuous function f of several block variables. At each iteration of this method, a single block of variables is optimized, while the remaining variables are held…

Optimization and Control · Mathematics 2012-09-12 Meisam Razaviyayn , Mingyi Hong , Zhi-Quan Luo

Motivated by distributed statistical learning over uncertain communication networks, we study distributed stochastic optimization by networked nodes to cooperatively minimize a sum of convex cost functions. The network is modeled by a…

Systems and Control · Electrical Eng. & Systems 2025-01-03 Yan Chen , Alexander L. Fradkov , Keli Fu , Xiaozheng Fu , Tao Li

This paper addresses a class of constrained optimization problems over networks in which local cost functions and constraints can be nonconvex. We propose an asynchronous distributed optimization algorithm, relying on the centralized Method…

Optimization and Control · Mathematics 2018-12-11 Francesco Farina , Andrea Garulli , Antonio Giannitrapani , Giuseppe Notarstefano