English
Related papers

Related papers: Geometric Bounds for Convergence Rates of Averagin…

200 papers

A distributed average consensus algorithm in which every sensor transmits with bounded peak power is proposed. In the presence of communication noise, it is shown that the nodes reach consensus asymptotically to a finite random variable…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-15 Sivaraman Dasarathan , Cihan Tepedelenlioglu , Mahesh Banavar , Andreas Spanias

We derive fundamental limitations on the performances of intrinsic averaging algorithms in open multi-agent systems, which are systems subject to random arrivals and departures of agents. Each agent holds a value, and their goal is to…

Multiagent Systems · Computer Science 2019-09-12 Charles Monnoyer de Galland , Julien M. Hendrickx

We derive fundamental performance limitations for intrinsic average consensus problems in open multi-agent systems, which are systems subject to frequent arrivals and departures of agents. Each agent holds a value, and the objective of the…

Multiagent Systems · Computer Science 2022-01-12 Charles Monnoyer de Galland , Julien M. Hendrickx

We consider distributed iterative algorithms for the averaging problem over time-varying topologies. Our focus is on the convergence time of such algorithms when complete (unquantized) information is available, and on the degradation of…

Optimization and Control · Mathematics 2009-01-14 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John Tsitsiklis

Consider a network whose nodes have some initial values, and it is desired to design an algorithm that builds on neighbor to neighbor interactions with the ultimate goal of convergence to the average of all initial node values or to some…

Optimization and Control · Mathematics 2014-09-16 Mahmoud El Chamie , Ji Liu , Tamer Başar

We consider a multi-agent system where each agent has its own estimate of a given quantity and the goal is to reach consensus on the average. To this purpose, we propose a distributed consensus algorithm that guarantees convergence to the…

Optimization and Control · Mathematics 2016-08-31 Alessandro Falsone , Kostas Margellos , Simone Garatti , Maria Prandini

The exchange algorithm is one of the most popular extensions of the Metropolis--Hastings algorithm to sample from doubly-intractable distributions. However, the theoretical exploration of the exchange algorithm is very limited. For example,…

Computation · Statistics 2021-08-20 Guanyang Wang

We introduce a simple time-triggered protocol to achieve communication-efficient non-Bayesian learning over a network. Specifically, we consider a scenario where a group of agents interact over a graph with the aim of discerning the true…

Systems and Control · Electrical Eng. & Systems 2019-09-05 Aritra Mitra , John A. Richards , Shreyas Sundaram

We consider parameter estimation in distributed networks, where each sensor in the network observes an independent sample from an underlying distribution and has $k$ bits to communicate its sample to a centralized processor which computes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-23 Yanjun Han , Ayfer Özgür , Tsachy Weissman

We present distributed algorithms that can be used by multiple agents to align their estimates with a particular value over a network with time-varying connectivity. Our framework is general in that this value can represent a consensus…

Optimization and Control · Mathematics 2010-04-20 Angelia Nedić , Asuman Ozdaglar , Pablo A. Parrilo

Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a…

Statistics Theory · Mathematics 2023-07-24 Riddhiman Bhattacharya , Galin L. Jones

In evolutionary optimization, it is important to understand how fast evolutionary algorithms converge to the optimum per generation, or their convergence rate. This paper proposes a new measure of the convergence rate, called average…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Jun He , Guangming Lin

Distributed averaging, or distributed average consensus, is a common method for computing the sample mean of the data dispersed among the nodes of a network in a decentralized manner. By iteratively exchanging messages with neighbors, the…

Information Theory · Computer Science 2017-10-26 Ryan Pilgrim , Junan Zhu , Dror Baron , Waheed U. Bajwa

This paper studies line planning for urban bus networks that face multiple resource limits such as budget, labor, and emission caps while using heterogeneous fleets. The objective is to maximize total reward from serving passengers by…

Optimization and Control · Mathematics 2026-04-07 Hongyi Jiang , Igor Averbakh , Samitha Samaranayake

Stochastic Gradient Descent (SGD) is the key learning algorithm for many machine learning tasks. Because of its computational costs, there is a growing interest in accelerating SGD on HPC resources like GPU clusters. However, the…

Machine Learning · Computer Science 2021-01-20 Peng Jiang , Gagan Agrawal

Consider the problem of approximating a given probability distribution on the cube $[0,1]^n$ via the use of a square lattice discretization with mesh-size $1/N$ and the Metropolis algorithm. Here the dimension $n$ is fixed and we focus for…

Probability · Mathematics 2022-02-01 Laurent Saloff-Coste , Sophie Uluatam

We study the average consensus problem of multi-agent systems for general network topologies with unidirectional information flow. We propose two (linear) distributed algorithms, deterministic and gossip, respectively for the cases where…

Systems and Control · Computer Science 2012-03-13 Kai Cai , Hideaki Ishii

This paper considers distributed average consensus using finite-bit bounded quantizer with possibly unbounded data. Under the framework of the alternating direction method of multipliers (ADMM), we develop distributed averaging algorithms…

Optimization and Control · Mathematics 2017-08-22 Shengyu Zhu , Biao Chen

We study convergence properties of pseudo-marginal Markov chain Monte Carlo algorithms (Andrieu and Roberts [Ann. Statist. 37 (2009) 697-725]). We find that the asymptotic variance of the pseudo-marginal algorithm is always at least as…

Probability · Mathematics 2015-03-31 Christophe Andrieu , Matti Vihola

In this paper, a distributed velocity-constrained consensus problem is studied for discrete-time multi-agent systems, where each agent's velocity is constrained to lie in a nonconvex set. A distributed constrained control algorithm is…

Optimization and Control · Mathematics 2020-03-05 Peng Lin , Wei Ren , Huijun Gao