English
Related papers

Related papers: Scalable Distributed Least Squares Algorithm for L…

200 papers

This paper considers the multi-agent linear least-squares problem in a server-agent network. In this problem, the system comprises multiple agents, each having a set of local data points, that are connected to a server. The goal for the…

Optimization and Control · Mathematics 2024-10-29 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

The problem of distributed identification of linear stochastic system with unknown coefficients over time-varying networks is considered. For estimating the unknown coefficients, each agent in the network can only access the input and the…

Systems and Control · Electrical Eng. & Systems 2021-08-04 Kewei Fu , Han-Fu Chen , Wenxiao Zhao

In realistic distributed optimization scenarios, individual nodes possess only partial information and communicate over bandwidth constrained channels. For this reason, the development of efficient distributed algorithms is essential. In…

Systems and Control · Electrical Eng. & Systems 2024-10-21 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

Many real-world applications are addressed through a linear least-squares problem formulation, whose solution is calculated by means of an iterative approach. A huge amount of studies has been carried out in the optimization field to…

Numerical Analysis · Mathematics 2013-11-25 Anastasia Cornelio , Federica Porta , Marco Prato , Luca Zanni

We study stochastic graph optimization problems in a novel distributed setting. As in the standard centralized setting, a random subgraph $G^*$ of a known base graph $G$ is realized by including each edge $e$ independently with a known…

Data Structures and Algorithms · Computer Science 2026-05-21 Keren Censor-Hillel , Aditi Dudeja , George Giakkoupis

The paper considers distributed stochastic optimization over randomly switching networks, where agents collaboratively minimize the average of all agents' local expectation-valued convex cost functions. Due to the stochasticity in gradient…

Optimization and Control · Mathematics 2022-04-07 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with…

Machine Learning · Computer Science 2016-11-17 Paolo Di Lorenzo , Sergio Barbarossa , Paolo Banelli , Stefania Sardellitti

We consider the problem of finding a sparse solution for an underdetermined linear system of equations when the known parameters on both sides of the system are subject to perturbation. This problem is particularly relevant to…

Systems and Control · Computer Science 2016-06-16 Reza Arablouei

We consider the problem of in-network compressed sensing from distributed measurements. Every agent has a set of measurements of a signal $x$, and the objective is for the agents to recover $x$ from their collective measurements using only…

Information Theory · Computer Science 2015-06-17 Stacy Patterson , Yonina C. Eldar , Idit Keidar

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The…

Optimization and Control · Mathematics 2020-12-02 Sindri Magnússon , Hossein Shokri-Ghadikolaei , Na Li

This paper presents a distributed continuous-time optimization framework aimed at overcoming the challenges posed by time-varying cost functions and constraints in multi-agent systems, particularly those subject to disturbances. By…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Zeinab Ebrahimi , Mohammad Deghat

This paper proposes a distributed alternating mixed discrete-continuous (DAMDC) algorithm to approach the oracle algorithm based on the diffusion strategy for parameter and spectrum estimation over sensor networks. A least mean squares…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-12 R. C. de Lamare

Many modern schedulers can dynamically adjust their service capacity to match the incoming workload. At the same time, however, unpredictability and instability in service capacity often incur operational and infrastructure costs. In this…

Optimization and Control · Mathematics 2020-05-12 Yorie Nakahira , Andres Ferragut , Adam Wierman

We have a set of processors (or agents) and a set of graph networks defined over some vertex set. Each processor can access a subset of the graph networks. Each processor has a demand specified as a pair of vertices $<u, v>$, along with a…

Data Structures and Algorithms · Computer Science 2012-10-08 Venkatesan T. Chakaravarthy , Sambuddha Roy , Yogish Sabharwal

Least squares estimation, a regression technique based on minimisation of residuals, has been invaluable in bringing the best fit solutions to parameters in science and engineering. However, in dynamic environments such as in Geomatics…

Computational Engineering, Finance, and Science · Computer Science 2018-04-17 C. P. E. Agbachi

We introduce an $(\epsilon, \delta)$-jointly differentially private algorithm for packing problems. Our algorithm not only achieves the optimal trade-off between the privacy parameter $\epsilon$ and the minimum supply requirement (up to…

Data Structures and Algorithms · Computer Science 2019-05-03 Zhiyi Huang , Xue Zhu

This paper proposes a new distributed algorithm for solving linear systems associated with a sparse graph under a generalised diagonal dominance assumption. The algorithm runs iteratively on each node of the graph, with low complexities on…

Signal Processing · Electrical Eng. & Systems 2019-04-30 Qianqian Cai , Zhaorong Zhang , Minyue Fu

This paper studies distributed resource allocation problem in multi-agent systems, where all the agents cooperatively minimize the sum of their cost functions with global resource constraints over stochastic communication networks. This…

Optimization and Control · Mathematics 2021-04-27 Tie Ding , Shanying Zhu , Cailian Chen , Xinping Guan

The classical iteratively reweighted least-squares (IRLS) algorithm aims to recover an unknown signal from linear measurements by performing a sequence of weighted least squares problems, where the weights are recursively updated at each…

Machine Learning · Statistics 2024-06-06 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

We develop and analyze an asynchronous algorithm for distributed convex optimization when the objective writes a sum of smooth functions, local to each worker, and a non-smooth function. Unlike many existing methods, our distributed…

Optimization and Control · Mathematics 2019-12-13 Konstantin Mishchenko , Franck Iutzeler , Jérôme Malick