English
Related papers

Related papers: Scalable Distributed Least Squares Algorithm for L…

200 papers

Learning the relationships between various entities from time-series data is essential in many applications. Gaussian graphical models have been studied to infer these relationships. However, existing algorithms process data in a batch at a…

Machine Learning · Computer Science 2021-10-04 Tong Yao , Shreyas Sundaram

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

The family of temporal difference (TD) methods span a spectrum from computationally frugal linear methods like TD({\lambda}) to data efficient least squares methods. Least square methods make the best use of available data directly…

Artificial Intelligence · Computer Science 2017-03-13 Yangchen Pan , Adam White , Martha White

Decentralized state estimation in a communication-constrained sensor network is considered. The exchanged estimates are dimension-reduced to reduce the communication load using a linear mapping to a lower-dimensional space. The mean squared…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Robin Forsling , Fredrik Gustafsson , Zoran Sjanic , Gustaf Hendeby

In this paper, we propose a stochastic scheduling strategy for estimating the states of N discrete-time linear time invariant (DTLTI) dynamic systems, where only one system can be observed by the sensor at each time instant due to practical…

Optimization and Control · Mathematics 2015-06-23 Chong Li , Nicola Elia

The problem of distributed optimization requires a group of networked agents to compute a parameter that minimizes the average of their local cost functions. While there are a variety of distributed optimization algorithms that can solve…

Multiagent Systems · Computer Science 2024-09-24 Kananart Kuwaranancharoen , Lei Xin , Shreyas Sundaram

In the real world a graph is often fragmented and distributed across different sites. This highlights the need for evaluating queries on distributed graphs. This paper proposes distributed evaluation algorithms for three classes of queries:…

Databases · Computer Science 2012-08-02 Wenfei Fan , Xin Wang , Yinghui Wu

This paper considers the problem of solving a symmetric positive definite system of linear equations over a network of agents with arbitrary asynchronous interactions and membership dynamics. The latter implies that each agent is allowed to…

Systems and Control · Computer Science 2016-06-14 Jie Lu , Choon Yik Tang

In this paper, the distributed strongly convex optimization problem is studied with spatio-temporal compressed communication and equality constraints. For the case where each agent holds an distributed local equality constraint, a…

Systems and Control · Electrical Eng. & Systems 2025-03-05 Zihao Ren , Lei Wang , Zhengguang Wu , Guodong Shi

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

Distributed computing is a standard way to scale up machine learning and data science algorithms to process large amounts of data. In such settings, avoiding communication amongst machines is paramount for achieving high performance. Rather…

Machine Learning · Statistics 2021-05-04 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

One of the most important problems in the field of distributed optimization is the problem of minimizing a sum of local convex objective functions over a networked system. Most of the existing work in this area focus on developing…

Optimization and Control · Mathematics 2019-01-08 Fatemeh Mansoori , Ermin Wei

We present a randomized iterative algorithm that exponentially converges in expectation to the minimum Euclidean norm least squares solution of a given linear system of equations. The expected number of arithmetic operations required to…

Numerical Analysis · Mathematics 2018-07-24 Anastasios Zouzias , Nikolaos Freris

This paper is concerned with the linear quadratic (LQ) optimal control of continuous-time system with terminal state constraint. In particular, multiple agents exist in the system which can only access partial information of the matrix…

Optimization and Control · Mathematics 2025-10-21 Wenjing Yang , Zhaorong Zhang , Juanjuan Xu

This paper develops a variant of the Least Squares Shadowing (LSS) method, which has successfully computed the derivative for several chaotic ODEs and PDEs. The development in this paper aims to simplify Least Squares Shadowing method by…

Dynamical Systems · Mathematics 2017-05-02 Mario Chater , Angxiu Ni , Qiqi Wang

The typical approach for recovery of spatially correlated signals is regularized least squares with a coupled regularization term. In the Bayesian framework, this algorithm is seen as a maximum-a-posterior estimator whose postulated prior…

Information Theory · Computer Science 2018-05-31 Ali Bereyhi , Saeid Haghighatshoar , Ralf R. Müller

We study the problem of finding the best linear model that can minimize least-squares loss given a data-set. While this problem is trivial in the low dimensional regime, it becomes more interesting in high dimensions where the population…

Machine Learning · Computer Science 2021-02-09 Yahya Sattar , Samet Oymak

We propose a distributed spectrum access algorithm for cognitive radio relay networks with multiple primary users (PU) and multiple secondary users (SU). The key idea behind the proposed algorithm is that the PUs negotiate with the SUs on…

Networking and Internet Architecture · Computer Science 2013-07-04 Siavash Bayat , Raymond H. Y. Louie , Branka Vucetic , Yonghui Li

This paper proposes a novel distributed optimization framework that addresses time-varying optimization problems without requiring explicit derivative information of the objective functions. Traditional distributed methods often rely on…

Optimization and Control · Mathematics 2025-09-29 Xuebin Li , Xuefei Yang , Emilia Fridman , Mamadou Diagne , Jiebao Sun

This paper is devoted to distributed continuous-time and discrete-time optimization problems with nonuniform convex constraint sets and nonuniform stepsizes for general differentiable convex objective functions. The communication graphs are…

Optimization and Control · Mathematics 2020-03-03 Peng Lin , Wei Ren , Chunhua Yang , Weihua Gui