English
Related papers

Related papers: Distributed Q-Learning with State Tracking for Mul…

200 papers

We address the problem of designing an LQR controller in a distributed setting, where M similar but not identical systems share their locally computed policy gradient (PG) estimates with a server that aggregates the estimates and computes a…

Optimization and Control · Mathematics 2024-04-16 Leonardo F. Toso , Han Wang , James Anderson

We consider a network of agents whose objective is for the aggregate of their states to converge to a solution of a linear program in standard form. Each agent has limited information about the problem data and can communicate with other…

Optimization and Control · Mathematics 2014-05-06 Dean Richert , Jorge Cortes

This paper deals with distributed policy optimization in reinforcement learning, which involves a central controller and a group of learners. In particular, two typical settings encountered in several applications are considered:…

Machine Learning · Computer Science 2021-04-21 Tianyi Chen , Kaiqing Zhang , Georgios B. Giannakis , Tamer Başar

This work is concerned with the finite-horizon optimal covariance steering of networked systems governed by discrete-time stochastic linear dynamics. In contrast with existing work that has only considered systems with dynamically decoupled…

Optimization and Control · Mathematics 2025-04-29 Ahmed Khalil , Yoonjae Lee , Efstathios Bakolas

We study the problem of designing a state feedback linear quadratic Gaussian (LQG) controller for a system in which the system matrices as well as the process noise covariance are unknown. We do a rigorous comparison between two approaches.…

Systems and Control · Electrical Eng. & Systems 2025-11-13 Mingxiang Liu , Damián Marelli , Minyue Fu , Qianqian Cai

We present a data-driven method for solving the linear quadratic regulator problem for systems with multiplicative disturbances, the distribution of which is only known through sample estimates. We adopt a distributionally robust approach…

Systems and Control · Electrical Eng. & Systems 2020-05-27 Peter Coppens , Mathijs Schuurmans , Panagiotis Patrinos

This paper studies a distributed policy gradient in collaborative multi-agent reinforcement learning (MARL), where agents over a communication network aim to find the optimal policy to maximize the average of all agents' local returns. Due…

Multiagent Systems · Computer Science 2022-12-06 Xiaoxiao Zhao , Jinlong Lei , Li Li , Jie Chen

In this paper, we address the problem of distributed interference management of cognitive femtocells that share the same frequency range with macrocells (primary user) using distributed multi-agent Q-learning. We formulate and solve three…

Multiagent Systems · Computer Science 2013-03-13 Hussein Saad , Amr Mohamed , Tamer ElBatt

In this paper, we will deal with a Linear Quadratic Optimal Control problem with unknown dynamics. As a modeling assumption, we will suppose that the knowledge that an agent has on the current system is represented by a probability…

Optimization and Control · Mathematics 2022-01-13 Andrea Pesare , Michele Palladino , Maurizio Falcone

We consider the problem of distributed hypothesis testing (or social learning) where a network of agents seeks to identify the true state of the world from a finite set of hypotheses, based on a series of stochastic signals that each agent…

Multiagent Systems · Computer Science 2020-04-06 Shreyas Sundaram , Aritra Mitra

Linear quadratic regulator (LQR) is one of the most popular frameworks to tackle continuous Markov decision process tasks. With its fundamental theory and tractable optimal policy, LQR has been revisited and analyzed in recent years, in…

Artificial Intelligence · Computer Science 2020-07-14 Youngsuk Park , Ryan A. Rossi , Zheng Wen , Gang Wu , Handong Zhao

Beyond specific settings, many multi-agent learning algorithms fail to converge to an equilibrium solution, instead displaying complex, non-stationary behaviours such as recurrent or chaotic orbits. In fact, recent literature suggests that…

Multiagent Systems · Computer Science 2026-02-12 Dan Leonte , Aamal Hussain , Raphael Huser , Francesco Belardinelli , Dario Paccagnan

This paper presents an adaptive combination strategy for distributed learning over diffusion networks. Since learning relies on the collaborative processing of the stochastic information at the dispersed agents, the overall performance can…

Multiagent Systems · Computer Science 2020-10-27 Y. Efe Erginbas , Stefan Vlaski , Ali H. Sayed

Efficient routing in IoT sensor networks is critical for minimizing energy consumption and latency. Traditional centralized algorithms, such as Dijkstra's, are computationally intensive and ill-suited for dynamic, distributed IoT…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Van-Vi Vo , Tien-Dung Nguyen , Duc-Tai Le , Hyunseung Choo

This paper develops a controller synthesis method for distributed LQG control problems under output-feedback. We consider a system consisting of three interconnected linear subsystems with a delayed information sharing structure. While the…

Systems and Control · Computer Science 2013-09-18 Hamid Reza Feyzmahdavian , Ather Gattami , Mikael Johansson

In this paper we present a set of projection-based designs for constructing simplified linear quadratic regulator (LQR) controllers for large-scale network systems. When such systems have tens of thousands of states, the design of…

Systems and Control · Computer Science 2017-10-05 Nan Xue , Aranya Chakrabortty

This paper studies the robustness of reinforcement learning algorithms to errors in the learning process. Specifically, we revisit the benchmark problem of discrete-time linear quadratic regulation (LQR) and study the long-standing open…

Optimization and Control · Mathematics 2021-03-16 Bo Pang , Zhong-Ping Jiang

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

Multiagent Systems · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia

This paper concerns imitation learning (IL) (i.e, the problem of learning to mimic expert behaviors from demonstrations) in cooperative multi-agent systems. The learning problem under consideration poses several challenges, characterized by…

Machine Learning · Computer Science 2023-10-11 The Viet Bui , Tien Mai , Thanh Hong Nguyen

This work studies networked agents cooperating to track a dynamical state of nature under partial information. The proposed algorithm is a distributed Bayesian filtering algorithm for finite-state hidden Markov models (HMMs). It can be used…

Signal Processing · Electrical Eng. & Systems 2022-12-07 Mert Kayaalp , Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed