English
Related papers

Related papers: Decoupled Delay Compensation: Enhancing Pre-traine…

200 papers

Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In…

Machine Learning · Computer Science 2024-02-12 Nikunj Gupta , Somjit Nath , Samira Ebrahimi Kahou

In this work, we introduce a novel perspective, i.e., dimensional analysis, to address the challenge of communication efficiency in Multi-Agent Reinforcement Learning (MARL). Our findings reveal that simply optimizing the content and timing…

Multiagent Systems · Computer Science 2025-05-20 Chuxiong Sun , Peng He , Rui Wang , Changwen Zheng

Multi-Agent Reinforcement Learning (MARL) has become a classic paradigm to solve diverse, intelligent control tasks like autonomous driving in Internet of Vehicles (IoV). However, the widely assumed existence of a central node to implement…

Multiagent Systems · Computer Science 2023-08-09 Xiaoxue Yu , Rongpeng Li , Fei Wang , Chenghui Peng , Chengchao Liang , Zhifeng Zhao , Honggang Zhang

We propose a simple yet effective alternative to reward normalization in policy gradient reinforcement learning by integrating a 1D Kalman filter for online reward estimation. Instead of relying on fixed heuristics, our method recursively…

Machine Learning · Computer Science 2026-04-28 Zixuan Xia , Quanxi Li

We consider the problem of multi-agent navigation and collision avoidance when observations are limited to the local neighborhood of each agent. We propose InforMARL, a novel architecture for multi-agent reinforcement learning (MARL) which…

Multiagent Systems · Computer Science 2023-05-17 Siddharth Nayak , Kenneth Choi , Wenqi Ding , Sydney Dolan , Karthik Gopalakrishnan , Hamsa Balakrishnan

Multi-Agent Reinforcement Learning (MARL) holds significant promise for enabling cooperative driving among Connected and Automated Vehicles (CAVs). However, its practical application is hindered by a critical limitation, i.e., insufficient…

Robotics · Computer Science 2025-12-01 Yuchen Shi , Huaxin Pei , Yi Zhang , Danya Yao

In multi-agent reinforcement learning (MARL), the centralized training with decentralized execution (CTDE) framework has gained widespread adoption due to its strong performance. However, the further development of CTDE faces two key…

Multiagent Systems · Computer Science 2024-12-25 Lunjun Liu , Weilai Jiang , Yaonan Wang

Multi-Agent Reinforcement Learning (MARL) methods find optimal policies for agents that operate in the presence of other learning agents. Central to achieving this is how the agents coordinate. One way to coordinate is by learning to…

Multiagent Systems · Computer Science 2020-04-10 Shubham Gupta , Rishi Hazra , Ambedkar Dukkipati

Consider a collaborative task carried out by two autonomous agents that are able to communicate over a noisy channel. Each agent is only aware of its own state, while the accomplishment of the task depends on the value of the joint state of…

Information Theory · Computer Science 2019-03-01 Arsham Mostaani , Osvaldo Simeone , Symeon Chatzinotas , Bjorn Ottersten

Classic reinforcement learning (RL) frequently confronts challenges in tasks involving delays, which cause a mismatch between received observations and subsequent actions, thereby deviating from the Markov assumption. Existing methods…

Machine Learning · Computer Science 2024-06-06 Bo Xia , Yilun Kong , Yongzhe Chang , Bo Yuan , Zhiheng Li , Xueqian Wang , Bin Liang

In this paper, we propose capturing and utilizing \textit{Temporal Information through Graph-based Embeddings and Representations} or \textbf{TIGER} to enhance multi-agent reinforcement learning (MARL). We explicitly model how inter-agent…

Machine Learning · Computer Science 2025-11-13 Nikunj Gupta , Ludwika Twardecka , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton

Offline-to-online deployment of reinforcement-learning (RL) agents must bridge two gaps: (1) the sim-to-real gap, where real systems add latency and other imperfections not present in simulation, and (2) the interaction gap, where policies…

Machine Learning · Computer Science 2026-02-12 Simon Sinong Zhan , Qingyuan Wu , Philip Wang , Frank Yang , Xiangyu Shi , Chao Huang , Qi Zhu

Multi-agent reinforcement learning (MARL) extends (single-agent) reinforcement learning (RL) by introducing additional agents and (potentially) partial observability of the environment. Consequently, algorithms for solving MARL problems…

Multiagent Systems · Computer Science 2019-09-12 Yilun Zhou , Derrik E. Asher , Nicholas R. Waytowich , Julie A. Shah

Multi-agent reinforcement learning (MARL) has attracted much research attention recently. However, unlike its single-agent counterpart, many theoretical and algorithmic aspects of MARL have not been well-understood. In this paper, we study…

Machine Learning · Computer Science 2021-12-08 Siliang Zeng , Tianyi Chen , Alfredo Garcia , Mingyi Hong

Efficient communication can enhance the overall performance of collaborative multi-agent reinforcement learning. A common approach is to share observations through full communication, leading to significant communication overhead. Existing…

Artificial Intelligence · Computer Science 2024-12-11 Dongkun Huo , Huateng Zhang , Yixue Hao , Yuanlin Ye , Long Hu , Rui Wang , Min Chen

This paper deals with distributed policy optimization in reinforcement learning, which involves a central controller and a group of learners. In particular, two typical settings encountered in several applications are considered:…

Machine Learning · Computer Science 2021-04-21 Tianyi Chen , Kaiqing Zhang , Georgios B. Giannakis , Tamer Başar

Scaling cooperative multi-agent reinforcement learning (MARL) is fundamentally limited by cross-agent noise. When agents share a common reward, each agent's learning signal is computed from a shared return that depends on all agents, so the…

Multiagent Systems · Computer Science 2026-05-06 Shan Yang , Yang Liu

This paper presents a dynamic state observer design for discrete-time linear time-varying systems that robustly achieves equalized recovery despite delayed or missing observations, where the set of all temporal patterns for the missing or…

Systems and Control · Electrical Eng. & Systems 2021-01-12 Syed M. Hassaan , Qiang Shen , Sze Zheng Yong

With wireless devices increasingly forming a unified smart network for seamless, user-friendly operations, random access (RA) medium access control (MAC) design is considered a key solution for handling unpredictable data traffic from…

Networking and Internet Architecture · Computer Science 2025-08-12 Myeung Suk Oh , Zhiyao Zhang , FNU Hairi , Alvaro Velasquez , Jia Liu