English
Related papers

Related papers: A principled framework for the design and analysis…

200 papers

We analyze the convergence of gradient-based optimization algorithms that base their updates on delayed stochastic gradient information. The main application of our results is to the development of gradient-based distributed optimization…

Optimization and Control · Mathematics 2011-05-02 Alekh Agarwal , John C. Duchi

Decentralized optimization over time-varying networks has a wide range of applications in distributed learning, signal processing and various distributed control problems. The agents of the distributed system locally hold optimization…

Optimization and Control · Mathematics 2023-12-14 Alexander Rogozin , Alexander Gasnikov , Aleksander Beznosikov , Dmitry Kovalev

In this paper, we hope to bring closer graph theory and consensus algorithms. Firstly, we give a brief introduction to graph theory by listing a concise definition. Then we analyze and visualize some commonly used graphs. Secondly, we…

Discrete Mathematics · Computer Science 2021-01-27 Shen Zheng

Privacy-preserving distributed processing has received considerable attention recently. The main purpose of these algorithms is to solve certain signal processing tasks over a network in a decentralised fashion without revealing…

Signal Processing · Electrical Eng. & Systems 2023-12-14 Sebastian O. Jordan , Qiongxiu Li , Richard Heusdens

We study gossip algorithms for the rumor spreading problem which asks one node to deliver a rumor to all nodes in an unknown network. We present the first protocol for any expander graph $G$ with $n$ nodes such that, the protocol informs…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-14 Zeyu Guo , He Sun

We attempt to better understand randomization in local distributed graph algorithms by exploring how randomness is used and what we can gain from it: - We first ask the question of how much randomness is needed to obtain efficient…

Data Structures and Algorithms · Computer Science 2019-06-04 Mohsen Ghaffari , Fabian Kuhn

As agentic platforms scale, agents are evolving beyond static roles and fixed toolchains, creating a growing need for flexible, decentralized coordination. Today's structured communication protocols (e.g., direct agent-to-agent messaging)…

Multiagent Systems · Computer Science 2025-08-05 Mansura Habiba , Nafiul I. Khan

Distributed average consensus is the main mechanism in algorithms for decentralized computation. In distributed average consensus algorithm each node has an initial state, and the goal is to compute the average of these initial states in…

Information Theory · Computer Science 2012-01-24 Saber Jafarizadeh , Abbas Jamalipour

By the distributed averaging problem is meant the problem of computing the average value of a set of numbers possessed by the agents in a distributed network using only communication between neighboring agents. Gossiping is a well-known…

Optimization and Control · Mathematics 2016-12-28 Ji Liu , Shaoshuai Mou , A. Stephen Morse , Brian D. O. Anderson , Changbin Yu

Although gossip and random walk-based learning algorithms are widely known for decentralized learning, there has been limited theoretical and experimental analysis to understand their relative performance for different graph topologies and…

Machine Learning · Computer Science 2026-04-20 Peyman Gholami , Hulya Seferoglu

In modern large-scale systems with sensor networks and IoT devices it is essential to collaboratively solve complex problems while utilizing network resources efficiently. In our paper we present three distributed optimization algorithms…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

Data transfer in opportunistic Delay Tolerant Networks (DTNs) must rely on unscheduled sporadic meetings between nodes. The main challenge in these networks is to develop a mechanism based on which nodes can learn to make nearly optimal…

Networking and Internet Architecture · Computer Science 2015-06-19 Shohreh Shaghaghian , Mark Coates

We consider distributed convex optimization problems that involve a separable objective function and nontrivial functional constraints, such as Linear Matrix Inequalities (LMIs). We propose a decentralized and computationally inexpensive…

Optimization and Control · Mathematics 2018-01-22 Soomin Lee , Michael M. Zavlanos

Effective communication is key to successful, decentralized, multi-robot path planning. Yet, it is far from obvious what information is crucial to the task at hand, and how and when it must be shared among robots. To side-step these issues…

Robotics · Computer Science 2020-07-15 Qingbiao Li , Fernando Gama , Alejandro Ribeiro , Amanda Prorok

This thesis is concerned with the design of distributed algorithms for solving optimization problems. We consider networks where each node has exclusive access to a cost function, and design algorithms that make all nodes cooperate to find…

Optimization and Control · Mathematics 2013-12-03 João F. C. Mota

In important applications involving multi-task networks with multiple objectives, agents in the network need to decide between these multiple objectives and reach an agreement about which single objective to follow for the network. In this…

Optimization and Control · Mathematics 2018-12-27 Sahar Khawatmi , Abdelhak M. Zoubir , Ali H. Sayed

We present a family of gossiping algorithms whose members share the same structure though they vary their performance in function of a combinatorial parameter. We show that such parameter may be considered as a "knob" controlling the amount…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-09 Vincenzo De Florio , Chris Blondia

This paper considers the decentralized consensus optimization problem defined over a network where each node holds a second-order differentiable local objective function. Our goal is to minimize the summation of local objective functions…

Optimization and Control · Mathematics 2020-08-25 Jiaojiao Zhang , Qing Ling , Anthony Man-Cho So

Several high-throughput distributed data-processing applications require multi-hop processing of streams of data. These applications include continual processing on data streams originating from a network of sensors, composing a multimedia…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-03-26 Shah Asaduzzaman , Muthucumaru Maheswaran

Distributed graph signal processing algorithms require the network nodes to communicate by exchanging messages in order to achieve a common objective. These messages have a finite precision in realistic networks, which may necessitate to…

Signal Processing · Electrical Eng. & Systems 2019-09-30 Isabela Cunha Maia Nobre , Pascal Frossard