English
Related papers

Related papers: Distributed Q-Learning with State Tracking for Mul…

200 papers

The state of the art for model predictive control (MPC)-based distributed Q-learning is limited to first-order gradient updates of the MPC parameterization. In general, using secondorder information can significantly improve the speed of…

Systems and Control · Electrical Eng. & Systems 2026-05-07 Samuel Mallick , Filippo Airaldi , Azita Dabiri , Bart De Schutter

When multiple agents learn in a decentralized manner, the environment appears non-stationary from the perspective of an individual agent due to the exploration and learning of the other agents. Recently proposed deep multi-agent…

Machine Learning · Computer Science 2020-06-16 Xueguang Lyu , Christopher Amato

Centralized training with decentralized execution has become an important paradigm in multi-agent learning. Though practical, current methods rely on restrictive assumptions to decompose the centralized value function across agents for…

Machine Learning · Computer Science 2020-06-11 Yaodong Yang , Ying Wen , Liheng Chen , Jun Wang , Kun Shao , David Mguni , Weinan Zhang

This study proposes the use of a social learning method to estimate a global state within a multi-agent off-policy actor-critic algorithm for reinforcement learning (RL) operating in a partially observable environment. We assume that the…

Machine Learning · Computer Science 2024-07-09 Ainur Zhaikhan , Ali H. Sayed

It poses technical difficulty to achieve stable tracking even for single mismatched nonlinear strict-feedback systems when intermittent state feedback is utilized. The underlying problem becomes even more complicated if such systems are…

Multiagent Systems · Computer Science 2022-08-08 Libei Sun , Xiucai Huang , Yongduan Song

This paper addresses the problem of distributed detection in multi-agent networks. Agents receive private signals about an unknown state of the world. The underlying state is globally identifiable, yet informative signals may be dispersed…

Optimization and Control · Mathematics 2014-10-01 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

This paper develops a novel approach to the consensus problem of multi-agent systems by minimizing a weighted state error with neighbor agents via linear quadratic (LQ) optimal control theory. Existing consensus control algorithms only…

Optimization and Control · Mathematics 2024-03-19 Liping Zhang , Juanjuan Xu , Huanshui Zhang , Lihua Xie

As next generation cellular networks become denser, associating users with the optimal base stations at each time while ensuring no base station is overloaded becomes critical for achieving stable and high network performance. We propose…

Signal Processing · Electrical Eng. & Systems 2024-12-31 Alireza Alizadeh , Byungju Lim , Mai Vu

Recently introduced distributed zeroth-order optimization (ZOO) algorithms have shown their utility in distributed reinforcement learning (RL). Unfortunately, in the gradient estimation process, almost all of them require random samples…

Systems and Control · Electrical Eng. & Systems 2024-05-06 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

This paper proposes a novel scalable type of multi-agent reinforcement learning-based coordination for distributed residential energy. Cooperating agents learn to control the flexibility offered by electric vehicles, space heating and…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Flora Charbonnier , Thomas Morstyn , Malcolm D. McCulloch

In this paper, we study a transfer learning framework for Linear Quadratic Regulator (LQR) control, where (i) the dynamics of the system of interest (target system) are unknown and only a short trajectory of impulse responses from the…

Systems and Control · Electrical Eng. & Systems 2025-05-05 Taosha Guo , Fabio Pasqualetti

Distributed Distributional DrQ is a model-free and off-policy RL algorithm for continuous control tasks based on the state and observation of the agent, which is an actor-critic method with the data-augmentation and the distributional…

Machine Learning · Computer Science 2024-04-17 Zehao Zhou

This paper studies a class of multi-agent reinforcement learning (MARL) problems where the reward that an agent receives depends on the states of other agents, but the next state only depends on the agent's own current state and action. We…

Multiagent Systems · Computer Science 2023-05-16 Xin Liu , Honghao Wei , Lei Ying

In this work, a dynamic system is controlled by multiple sensor-actuator agents, each of them commanding and observing parts of the system's input and output. The different agents sporadically exchange data with each other via a common bus…

Systems and Control · Computer Science 2017-07-14 Michael Muehlebach , Sebastian Trimpe

We propose a method for modeling and learning turn-taking behaviors for accessing a shared resource. We model the individual behavior for each agent in an interaction and then use a multi-agent fusion model to generate a summary over the…

Machine Learning · Computer Science 2018-12-12 Katherine Metcalf , Barry-John Theobald , Nicholas Apostoloff

In this paper, we investigate the distributed optimal control problem for a kind of nonlinear multi-agent systems. In particular,both the state and the system dynamic structures of each agent are private and can only be shared among…

Optimization and Control · Mathematics 2026-04-08 Ruixue Li , Wenjing Yang , Zhaorong Zhang , Xun Li , Juanjuan Xu

We study model-free learning methods for the output-feedback Linear Quadratic (LQ) control problem in finite-horizon subject to subspace constraints on the control policy. Subspace constraints naturally arise in the field of distributed…

Systems and Control · Electrical Eng. & Systems 2021-07-14 Luca Furieri , Yang Zheng , Maryam Kamgarpour

When the data used for reinforcement learning (RL) are collected by multiple agents in a distributed manner, federated versions of RL algorithms allow collaborative learning without the need for agents to share their local data. In this…

Machine Learning · Computer Science 2023-12-14 Jiin Woo , Gauri Joshi , Yuejie Chi

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network where the interactions of the agents during learning may lead to a…

Machine Learning · Computer Science 2022-05-30 Ankita Tondwalkar , Andres Kwasinski

An event-based state estimation approach for reducing communication in a networked control system is proposed. Multiple distributed sensor-actuator-agents observe a dynamic process and sporadically exchange their measurements and inputs…

Systems and Control · Computer Science 2017-01-30 Sebastian Trimpe