English
Related papers

Related papers: Non-Asymptotic Analysis of an Optimal Algorithm fo…

200 papers

This paper proposes a multi-scale method to design a continuous-time distributed algorithm for constrained convex optimization problems by using multi-agents with Markov switched network dynamics and noisy inter-agent communications. Unlike…

Optimization and Control · Mathematics 2021-03-02 Wei Ni , Xiaoli Wang

Graph signal processing (GSP) provides a powerful framework for analyzing signals arising in a variety of domains. In many applications of GSP, multiple network structures are available, each of which captures different aspects of the same…

Machine Learning · Statistics 2021-11-03 Michael Weylandt , George Michailidis , T. Mitchell Roddenberry

This thesis is concerned with distributed control and coordination of networks consisting of multiple, potentially mobile, agents. This is motivated mainly by the emergence of large scale networks characterized by the lack of centralized…

Optimization and Control · Mathematics 2010-10-01 Alex Olshevsky

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

In this paper we propose a distributed algorithm for the estimation and control of the connectivity of ad-hoc networks in the presence of a random topology. First, given a generic random graph, we introduce a novel stochastic power…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-17 Paolo Di Lorenzo , Sergio Barbarossa

In this paper, we consider the unconstrained distributed optimization problem, in which the exchange of information in the network is captured by a directed graph topology, thus, nodes can only communicate with their neighbors.…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

We present a distributed (non-Bayesian) learning algorithm for the problem of parameter estimation with Gaussian noise. The algorithm is expressed as explicit updates on the parameters of the Gaussian beliefs (i.e. means and precision). We…

Optimization and Control · Mathematics 2016-12-08 Angelia Nedić , Alex Olshevsky , César A. Uribe

In this paper we study the distributed average consensus problem in multi-agent systems with directed communication links that are subject to quantized information flow. Specifically, we present and analyze a distributed averaging algorithm…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Apostolos I. Rikos , Christoforos N. Hadjicostis , Karl H. Johansson

This paper studies the decentralized learning of tree-structured Gaussian graphical models (GGMs) from noisy data. In decentralized learning, data set is distributed across different machines (sensors), and GGMs are widely used to model…

Machine Learning · Computer Science 2021-09-23 Akram Hussain

The problem of connectivity assessment in an asymmetric network represented by a weighted directed graph is investigated in this article. A power iteration algorithm in a centralized implementation is developed first to compute the…

Systems and Control · Electrical Eng. & Systems 2023-08-10 M. Mehdi Asadi , Mohammad Khosravi , Hesam Mosalli , Stephane Blouin , Amir G. Aghdam

We study non-convex distributed optimization problems where a set of agents collaboratively solve a separable optimization problem that is distributed over a time-varying network. The existing methods to solve these problems rely on (at…

Optimization and Control · Mathematics 2022-04-26 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer

The consensus problem in distributed computing involves a network of agents aiming to compute the average of their initial vectors through local communication, represented by an undirected graph. This paper focuses on the studying of this…

Optimization and Control · Mathematics 2024-11-26 Nhat Trung Nguyen , Alexander Rogozin , Alexander Gasnikov

Distributed Optimization is an increasingly important subject area with the rise of multi-agent control and optimization. We consider a decentralized stochastic optimization problem where the agents on a graph aim to asynchronously optimize…

Optimization and Control · Mathematics 2021-10-22 Vyacheslav Kungurtsev , Mahdi Morafah , Tara Javidi , Gesualdo Scutari

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

Multiagent Systems · Computer Science 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

A distributed average consensus algorithm robust to a wide range of impulsive channel noise distributions is proposed. This work is the first of its kind in the literature to propose a consensus algorithm which relaxes the requirement of…

Systems and Control · Computer Science 2015-06-22 Sivaraman Dasarathan , Cihan Tepedelenlioglu , Mahesh Banavar , Andreas Spanias

This work studies nonconvex distributed constrained optimization over stochastic communication networks. We revisit the distributed dual averaging algorithm, which is known to converge for convex problems. We start from the centralized…

Optimization and Control · Mathematics 2022-11-15 Changxin Liu , Xuyang Wu , Xinlei Yi , Yang Shi , Karl H. Johansson

We analyse the learning performance of Distributed Gradient Descent in the context of multi-agent decentralised non-parametric regression with the square loss function when i.i.d. samples are assigned to agents. We show that if agents hold…

Machine Learning · Statistics 2019-11-14 Dominic Richards , Patrick Rebeschini

We consider the problem of deciding, based on a single noisy measurement at each vertex of a given graph, whether the underlying unknown signal is constant over the graph or there exists a cluster of vertices with anomalous activation. This…

Statistics Theory · Mathematics 2014-09-23 James Sharpnack , Alessandro Rinaldo , Aarti Singh

In this paper we study the influence of additive noise in randomized consensus algorithms. Assuming that the update matrices are symmetric, we derive a closed form expression for the mean square error induced by the noise, together with…

Systems and Control · Electrical Eng. & Systems 2020-06-11 Renato Vizuete , Paolo Frasca , Elena Panteley