English
Related papers

Related papers: Distributed Optimization over Directed Graphs with…

200 papers

We study nonconvex distributed optimization in multiagent networks where the communications between nodes is modeled as a time-varying sequence of arbitrary digraphs. We introduce a novel broadcast-based distributed algorithmic framework…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Ying Sun , Gesualdo Scutari , Daniel Palomar

This paper discusses distributed optimization over a directed graph. We begin with some well known algorithms which achieve consensus among agents including FROST [1], which possesses the quickest convergence to the optimum. It is a well…

Optimization and Control · Mathematics 2021-02-12 Shuubham Ojha , Ketan Rajawat

In this paper, we consider distributed optimization problems where $n$ agents, each possessing a local cost function, collaboratively minimize the average of the local cost functions over a connected network. To solve the problem, we…

Optimization and Control · Mathematics 2023-03-24 Kun Huang , Xiao Li , Andre Milzarek , Shi Pu , Junwen Qiu

In this paper, we study the optimal convergence rate for distributed convex optimization problems in networks. We model the communication restrictions imposed by the network as a set of affine constraints and provide optimal complexity…

Optimization and Control · Mathematics 2018-11-16 César A. Uribe , Soomin Lee , Alexander Gasnikov , Angelia Nedić

Distributed stochastic optimization has drawn great attention recently due to its effectiveness in solving large-scale machine learning problems. Though numerous algorithms have been proposed and successfully applied to general practical…

Optimization and Control · Mathematics 2023-12-15 Kun Huang , Xiao Li , Shi Pu

In this paper, we study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

We study the averaging-based distributed optimization solvers over random networks. We show a general result on the convergence of such schemes using weight-matrices that are row-stochastic almost surely and column-stochastic in expectation…

Optimization and Control · Mathematics 2020-10-06 Adel Aghajan , Behrouz Touri

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini

In this paper, we consider the unconstrained distributed optimization problem, in which the exchange of information in the network is captured by a directed graph topology, thus, nodes can only communicate with their neighbors.…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging information such as…

Machine Learning · Computer Science 2017-10-31 Jianqiao Wangni , Jialei Wang , Ji Liu , Tong Zhang

We study distributed multi-agent large-scale optimization problems, wherein the cost function is composed of a smooth possibly nonconvex sum-utility plus a DC (Difference-of-Convex) regularizer. We consider the scenario where the dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-29 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

We consider convex and nonconvex constrained optimization with a partially separable objective function: agents minimize the sum of local objective functions, each of which is known only by the associated agent and depends on the variables…

Optimization and Control · Mathematics 2020-10-20 Loris Cannelli , Francisco Facchinei , Gesualdo Scutari , Vyacheslav Kungurtsev

In this paper, we focus on solving a distributed convex aggregative optimization problem in a network, where each agent has its own cost function which depends not only on its own decision variables but also on the aggregated function of…

Optimization and Control · Mathematics 2022-07-26 Tongyu Wang , Peng Yi

This paper studies the continuous-time distributed optimization of a sum of convex functions over directed graphs. Contrary to what is known in the consensus literature, where the same dynamics works for both undirected and directed…

Optimization and Control · Mathematics 2015-03-20 Bahman Gharesifard , Jorge Cortes

In this paper we deal with a network of computing agents with local processing and neighboring communication capabilities that aim at solving (without any central unit) a submodular optimization problem. The cost function is the sum of many…

Optimization and Control · Mathematics 2020-05-26 Andrea Testa , Francesco Farina , Giuseppe Notarstefano

To design algorithms that reduce communication cost or meet rate constraints and are robust to communication noise, we study convex distributed optimization problems where a set of agents are interested in solving a separable optimization…

Optimization and Control · Mathematics 2023-05-02 Hadi Reisizadeh , Anand Gokhale , Behrouz Touri , Soheil Mohajer

This paper investigates the distributed fixed point seeking problem of sum-separable stochastic operators over the multi-agent network. Based on inexact Krasnosel'ski\u{\i}--Mann iterations, the communication-efficient distributed algorithm…

Optimization and Control · Mathematics 2026-05-22 Fan Li , Lei Xu , Xinlei Yi , Guanghui Wen , Yang Shi , Tao Yang

Distributed optimization has gained significant attention in recent years, primarily fueled by the availability of a large amount of data and privacy-preserving requirements. This paper presents a fixed-time convergent optimization…

Systems and Control · Computer Science 2022-05-30 Kunal Garg , Mayank Baranwal

This paper proposes a distributed algorithm for a network of agents to solve an optimization problem with separable objective function and locally coupled constraints. Our strategy is based on reformulating the original constrained problem…

Optimization and Control · Mathematics 2021-03-12 Priyank Srivastava , Jorge Cortes

We consider distributed online convex optimization problems, where the distributed system consists of various computing units connected through a time-varying communication graph. In each time step, each computing unit selects a constrained…

Machine Learning · Computer Science 2019-12-23 Deming Yuan , Alexandre Proutiere , Guodong Shi