English
Related papers

Related papers: Distributed TD(0) with Almost No Communication

200 papers

In Part II [3] we carried out a detailed mean-square-error analysis of the performance of asynchronous adaptation and learning over networks under a fairly general model for asynchronous events including random topologies, random link…

Systems and Control · Computer Science 2014-12-17 Xiaochuan Zhao , Ali H. Sayed

We consider a convex unconstrained optimization problem that arises in a network of agents whose goal is to cooperatively optimize the sum of the individual agent objective functions through local computations and communications. For this…

Optimization and Control · Mathematics 2008-03-11 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John N. Tsitsiklis

A novel approach to solve the problem of distributed state estimation of linear time-invariant systems is proposed in this paper. It relies on the application of parameter estimation-based observers, where the state observation task is…

Systems and Control · Electrical Eng. & Systems 2020-05-28 Romeo Ortega , Emmanuel Nuño , Alexei Bobtsov

We study the distributed synthesis of policies for multi-agent systems to perform \emph{spatial-temporal} tasks. We formalize the synthesis problem as a \emph{factored} Markov decision process subject to \emph{graph temporal logic}…

Multiagent Systems · Computer Science 2021-06-02 Murat Cubuktepe , Zhe Xu , Ufuk Topcu

Consider $n$ agents connected over a network collaborating to minimize the average of their local cost functions combined with a common nonsmooth function. This paper introduces a unified algorithmic framework for solving such a problem…

Optimization and Control · Mathematics 2026-05-05 Kun Huang , Shi Pu , Angelia Nedić

We present a hybrid systems framework for distributed multi-agent optimization in which agents execute computations in continuous time and communicate in discrete time. The optimization algorithm is analogous to a continuous-time form of…

Optimization and Control · Mathematics 2026-03-17 Katherine R. Hendrickson , Dawn M. Hustig-Schultz , Matthew T. Hale , Ricardo G. Sanfelice

Stochastic models in which agents interact with their neighborhood according to a network topology are a powerful modeling framework to study the emergence of complex dynamic patterns in real-world systems. Stochastic simulations are often…

Social and Information Networks · Computer Science 2021-01-27 Gerrit Großmann , Luca Bortolussi , Verena Wolf

We apply large deviations theory to study asymptotic performance of running consensus distributed detection in sensor networks. Running consensus is a stochastic approximation type algorithm, recently proposed. At each time step k, the…

Information Theory · Computer Science 2010-10-26 Dragana Bajovic , Dusan Jakovetic , Joao Xavier , Bruno Sinopoli , Jose M. F. Moura

We introduce a generalization of temporal-difference (TD) learning to networks of interrelated predictions. Rather than relating a single prediction to itself at a later time, as in conventional TD methods, a TD network relates each…

Machine Learning · Computer Science 2015-04-22 Richard S. Sutton , Brian Tanner

Motivated by broad applications in reinforcement learning and federated learning, we study local stochastic approximation over a network of agents, where their goal is to find the root of an operator composed of the local operators at the…

Machine Learning · Computer Science 2020-06-25 Thinh T. Doan

We present DUAL-LOCO, a communication-efficient algorithm for distributed statistical estimation. DUAL-LOCO assumes that the data is distributed according to the features rather than the samples. It requires only a single round of…

Machine Learning · Statistics 2016-08-04 Christina Heinze , Brian McWilliams , Nicolai Meinshausen

In this paper, we consider distributed optimization problems where $n$ agents, each possessing a local cost function, collaboratively minimize the average of the local cost functions over a connected network. To solve the problem, we…

Optimization and Control · Mathematics 2023-03-24 Kun Huang , Xiao Li , Andre Milzarek , Shi Pu , Junwen Qiu

This paper proposes a distributed optimization algorithm with a convergence time that can be assigned in advance according to task requirements. To this end, a sliding manifold is introduced to achieve the sum of local gradients approaching…

Optimization and Control · Mathematics 2024-12-31 Renyongkang Zhang , Ge Guo , Zeng-di Zhou

In this work we derive the performance achievable by a network of distributed agents that solve, adaptively and in the presence of communication constraints, a regression problem. Agents employ the recently proposed ACTC…

Machine Learning · Computer Science 2025-04-25 Marco Carpentiero , Vincenzo Matta , Ali H. Sayed

This paper proposes a reinforcement learning (RL)-based backstepping control strategy to achieve fixed time consensus in nonlinear multi-agent systems with strict feedback dynamics. Agents exchange only output information with their…

Systems and Control · Electrical Eng. & Systems 2025-07-23 Aria Delshad , Maryam Babazadeh

Distributed averaging of agent initial conditions is a well-studied problem in context of networked systems where coordination amongst the agents is of paramount importance. The asymptotic nature of convergence of distributed averaging…

Optimization and Control · Mathematics 2017-04-28 Mangal Prakash , Saurav Talukdar , Sandeep Attree , Sourav Patel , Murti V. Salapaka

We consider the problem of distributed hypothesis testing (or social learning) where a network of agents seeks to identify the true state of the world from a finite set of hypotheses, based on a series of stochastic signals that each agent…

Multiagent Systems · Computer Science 2020-04-06 Shreyas Sundaram , Aritra Mitra

The problem of minimizing a sum of local convex objective functions over a networked system captures many important applications and has received much attention in the distributed optimization field. Most of existing work focuses on…

Optimization and Control · Mathematics 2019-01-09 Fatemeh Mansoori , Ermin Wei

Distributed sensor networks often include a multitude of sensors, each measuring parts of a process state space or observing the operations of a system. Communication of measurements between the sensor nodes and estimator(s) cannot…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Sanjay Chandrasekaran , Vishnu Varadan , Siva Vignesh Krishnan , Florian Dörfler , Mohammad H. Mamduhi

We propose a distributed control and coordination strategy for multi-agent systems where each agent has a local task specified as a Linear Temporal Logic (LTL) formula and at the same time is subject to relative-distance constraints with…

Multiagent Systems · Computer Science 2014-11-03 Meng Guo , Jana Tumova , Dimos V. Dimarogonas