English
Related papers

Related papers: A Multi-Agent Off-Policy Actor-Critic Algorithm fo…

200 papers

Offline meta-reinforcement learning (OMRL) proficiently allows an agent to tackle novel tasks while solely relying on a static dataset. For precise and efficient task identification, existing OMRL research suggests learning separate task…

Machine Learning · Computer Science 2024-03-13 Chengxing Jia , Fuxiang Zhang , Yi-Chen Li , Chen-Xiao Gao , Xu-Hui Liu , Lei Yuan , Zongzhang Zhang , Yang Yu

Reinforcement learning (RL) algorithms can find an optimal policy for a single agent to accomplish a particular task. However, many real-world problems require multiple agents to collaborate in order to achieve a common goal. For example, a…

Machine Learning · Computer Science 2025-10-20 Jan Corazza , Hadi Partovi Aria , Hyohun Kim , Daniel Neider , Zhe Xu

Cooperative multi-agent systems can be naturally used to model many real world problems, such as network packet routing and the coordination of autonomous vehicles. There is a great need for new reinforcement learning methods that can…

Artificial Intelligence · Computer Science 2024-12-12 Jakob Foerster , Gregory Farquhar , Triantafyllos Afouras , Nantas Nardelli , Shimon Whiteson

The performance of reinforcement learning depends upon designing an appropriate action space, where the effect of each action is measurable, yet, granular enough to permit flexible behavior. So far, this process involved non-trivial user…

Machine Learning · Computer Science 2021-06-08 Edoardo Cetin , Oya Celiktutan

The paper considers independent reinforcement learning (IRL) for multi-agent collaborative decision-making in the paradigm of federated learning (FL). However, FL generates excessive communication overheads between agents and a remote…

Machine Learning · Computer Science 2023-05-30 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

In multi-agent reinforcement learning, the inherent non-stationarity of the environment caused by other agents' actions posed significant difficulties for an agent to learn a good policy independently. One way to deal with non-stationarity…

Machine Learning · Computer Science 2022-06-22 Haobin Jiang , Yifan Yu , Zongqing Lu

This paper studies a distributed policy gradient in collaborative multi-agent reinforcement learning (MARL), where agents over a communication network aim to find the optimal policy to maximize the average of all agents' local returns. Due…

Multiagent Systems · Computer Science 2022-12-06 Xiaoxiao Zhao , Jinlong Lei , Li Li , Jie Chen

We study a multi-agent reinforcement learning dynamics, and analyze its asymptotic behavior in infinite-horizon discounted Markov potential games. We focus on the independent and decentralized setting, where players do not know the game…

Machine Learning · Computer Science 2025-04-02 Chinmay Maheshwari , Manxi Wu , Druv Pai , Shankar Sastry

Communication is essential for coordination among humans and animals. Therefore, with the introduction of intelligent agents into the world, agent-to-agent and agent-to-human communication becomes necessary. In this paper, we first study…

Multiagent Systems · Computer Science 2021-03-04 Varun Bhatt , Michael Buro

Actor-critic algorithms are widely used in reinforcement learning, but are challenging to mathematically analyse due to the online arrival of non-i.i.d. data samples. The distribution of the data samples dynamically changes as the model is…

Machine Learning · Computer Science 2023-09-20 Ziheng Wang , Justin Sirignano

Multi-agent reinforcement learning shines as the pinnacle of multi-agent systems, conquering intricate real-world challenges, fostering collaboration and coordination among agents, and unleashing the potential for intelligent…

Multiagent Systems · Computer Science 2023-12-27 Jiawei Wang , Jian Zhao , Zhengtao Cao , Ruili Feng , Rongjun Qin , Yang Yu

We propose a new objective, the counterfactual objective, unifying existing objectives for off-policy policy gradient algorithms in the continuing reinforcement learning (RL) setting. Compared to the commonly used excursion objective, which…

Machine Learning · Computer Science 2019-10-29 Shangtong Zhang , Wendelin Boehmer , Shimon Whiteson

We consider task allocation for multi-object transport using a multi-robot system, in which each robot selects one object among multiple objects with different and unknown weights. The existing centralized methods assume the number of…

Robotics · Computer Science 2022-12-07 Kazuki Shibata , Tomohiko Jimbo , Tadashi Odashima , Keisuke Takeshita , Takamitsu Matsubara

Diffusion models have become a popular choice for representing actor policies in behavior cloning and offline reinforcement learning. This is due to their natural ability to optimize an expressive class of distributions over a continuous…

Machine Learning · Computer Science 2025-02-17 Michael Psenka , Alejandro Escontrela , Pieter Abbeel , Yi Ma

Popular methods in cooperative Multi-Agent Reinforcement Learning with partially observable environments typically allow agents to act independently during execution, which may limit the coordinated effect of the trained policies. However,…

Multiagent Systems · Computer Science 2025-07-22 Faizan Contractor , Li Li , Ranwa Al Mallah

This paper proposes a scalable distributed policy gradient method and proves its convergence to near-optimal solution in multi-agent linear quadratic networked systems. The agents engage within a specified network under local communication…

Multiagent Systems · Computer Science 2024-03-06 Yuzi Yan , Yuan Shen

Improving the efficiency of dispatching orders to vehicles is a research hotspot in online ride-hailing systems. Most of the existing solutions for order-dispatching are centralized controlling, which require to consider all possible…

Multiagent Systems · Computer Science 2019-10-08 Ming Zhou , Jiarui Jin , Weinan Zhang , Zhiwei Qin , Yan Jiao , Chenxi Wang , Guobin Wu , Yong Yu , Jieping Ye

This paper studies the performative policy learning problem, where agents adjust their features in response to a released policy to improve their potential outcomes, inducing an endogenous distribution shift. There has been growing interest…

Machine Learning · Computer Science 2025-02-25 Qianyi Chen , Ying Chen , Bo Li

The collaboration between agents has gradually become an important topic in multi-agent systems. The key is how to efficiently solve the credit assignment problems. This paper introduces MGAN for collaborative multi-agent reinforcement…

Multiagent Systems · Computer Science 2021-05-14 Zhiwei Xu , Bin Zhang , Yunpeng Bai , Dapeng Li , Guoliang Fan

Extracting relevant information from a stream of high-dimensional observations is a central challenge for deep reinforcement learning agents. Actor-critic algorithms add further complexity to this challenge, as it is often unclear whether…