English
Related papers

Related papers: Distributed Q-Learning with State Tracking for Mul…

200 papers

In this paper, we propose a design of a model-free networked controller for a nonlinear plant whose mathematical model is unknown. In a networked control system, the controller and plant are located away from each other and exchange data…

Machine Learning · Computer Science 2019-09-02 Junya Ikemoto , Toshimitsu Ushio

This paper proposes a distributed event-triggered control method that not only guarantees consensus of multi-agent systems but also satisfies a given LQ performance constraint. Taking the standard distributed control scheme with all-time…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Shumpei Nishida , Kunihisa Okano

One of the challenges for multi-agent reinforcement learning (MARL) is designing efficient learning algorithms for a large system in which each agent has only limited or partial information of the entire system. While exciting progress has…

Machine Learning · Computer Science 2022-02-22 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

We investigate the problem of learning linear quadratic regulators (LQR) in a multi-task, heterogeneous, and model-free setting. We characterize the stability and personalization guarantees of a policy gradient-based (PG) model-agnostic…

Optimization and Control · Mathematics 2024-06-04 Leonardo F. Toso , Donglin Zhan , James Anderson , Han Wang

State estimation for a class of linear time-invariant systems with distributed output measurements (distributed sensors) and unknown inputs is addressed in this paper. The objective is to design a network of observers such that the state…

Systems and Control · Electrical Eng. & Systems 2021-10-12 Guitao Yang , Angelo Barboni , Hamed Rezaee , Thomas Parisini

Most data-driven analysis and control methods rely on centralized access to system measurements. In contrast, we consider a setting in which the measurements are distributed across multiple agents and raw data are not shared. Each agent has…

Optimization and Control · Mathematics 2026-03-12 Surya Malladi , Nima Monshizadeh

This paper introduces a novel data-driven approach to design a linear quadratic regulator (LQR) using a reinforcement learning (RL) algorithm that does not require a system model. The key contribution is to perform policy iteration (PI) by…

Systems and Control · Electrical Eng. & Systems 2023-11-20 Soroush Asri , Luis Rodrigues

Inspired by a graph-based technique for predicting molecular properties in quantum chemistry -- atoms' position within molecules in three-dimensional space -- we present Q-MARL, a completely decentralised learning architecture that supports…

Machine Learning · Computer Science 2025-03-11 Kha Vo , Chin-Teng Lin

Reinforcement Learning algorithms have recently been proposed to learn time-sequential control policies in the field of autonomous driving. Direct applications of Reinforcement Learning algorithms with discrete action space will yield…

Machine Learning · Computer Science 2019-12-03 Pin Wang , Hanhan Li , Ching-Yao Chan

We propose ScalarFedLQR, a communication-efficient federated algorithm for model-free learning of a common policy in linear quadratic regulator (LQR) control of heterogeneous agents. The method builds on a decomposed projected gradient…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Mohammadreza Rostami , Shahriar Talebi , Solmaz S. Kia

We propose a reinforcement learning (RL)-based algorithm to jointly train (1) a trajectory planner and (2) a tracking controller in a layered control architecture. Our algorithm arises naturally from a rewrite of the underlying optimal…

Systems and Control · Electrical Eng. & Systems 2024-12-18 Fengjun Yang , Nikolai Matni

In this paper, we explore the susceptibility of the independent Q-learning algorithms (a classical and widely used multi-agent reinforcement learning method) to strategic manipulation of sophisticated opponents in normal-form games played…

Computer Science and Game Theory · Computer Science 2024-07-17 Yuksel Arslantas , Ege Yuceel , Muhammed O. Sayin

This paper considers the optimal distributed control problem for a linear stochastic multi-agent system (MAS). Due to the distributed nature of MAS network, the information available to an individual agent is limited to its vicinity. From…

Systems and Control · Electrical Eng. & Systems 2021-06-15 Hojin Lee , Cheolhyeon Kwon

This paper studies the distributed state estimation in sensor network, where $m$ sensors are deployed to infer the $n$-dimensional state of a linear time-invariant (LTI) Gaussian system. By a lossless decomposition of optimal steady-state…

Systems and Control · Electrical Eng. & Systems 2022-04-22 Jiaqi Yan , Xu Yang , Yilin Mo , Keyou You

The management of networks is automated by closed loops. Concurrent closed loops aiming for individual optimization cause conflicts which, left unresolved, leads to significant degradation in performance indicators, resulting in sub-optimal…

Networking and Internet Architecture · Computer Science 2024-10-28 Sayantini Majumdar , Riccardo Trivisonno , Georg Carle

In this paper, we consider the problem of multi-agent navigation in partially observable grid environments. This problem is challenging for centralized planning approaches as they, typically, rely on the full knowledge of the environment.…

Machine Learning · Computer Science 2021-08-16 Vasilii Davydov , Alexey Skrynnik , Konstantin Yakovlev , Aleksandr I. Panov

This work develops effective distributed strategies for the solution of constrained multi-agent stochastic optimization problems with coupled parameters across the agents. In this formulation, each agent is influenced by only a subset of…

Optimization and Control · Mathematics 2019-03-15 Sulaiman A. Alghunaim , Ali H. Sayed

Applications of reinforcement learning (RL) to stabilization problems of real systems are restricted since an agent needs many experiences to learn an optimal policy and may determine dangerous actions during its exploration. If we know a…

Machine Learning · Computer Science 2021-04-20 Junya Ikemoto , Toshimitsu Ushio

Q-learning is a powerful tool for network control and policy optimization in wireless networks, but it struggles with large state spaces. Recent advancements, like multi-environment mixed Q-learning (MEMQ), improves performance and reduces…

Signal Processing · Electrical Eng. & Systems 2024-12-31 Talha Bozkus , Urbashi Mitra

Distributed state estimation is examined for a sensor network tasked with reconstructing a system's state through the use of a distributed and event-triggered observer. Each agent in the sensor network employs a deep neural network (DNN) to…

Systems and Control · Electrical Eng. & Systems 2022-02-07 Federico M. Zegers , Runhan Sun , Girish Chowdhary , Warren E. Dixon