English
Related papers

Related papers: FACMAC: Factored Multi-Agent Centralised Policy Gr…

200 papers

Federated reinforcement learning (FRL) has emerged as a promising paradigm, enabling multiple agents to collaborate and learn a shared policy adaptable across heterogeneous environments. Among the various reinforcement learning (RL)…

Machine Learning · Computer Science 2024-12-25 Ye Zhu , Xiaowen Gong

Training a game-playing reinforcement learning agent requires multiple interactions with the environment. Ignorant random exploration may cause a waste of time and resources. It's essential to alleviate such waste. As discussed in this…

Machine Learning · Computer Science 2022-06-24 Tairan Huang , Xu Li , Hao Li , Mingming Sun , Ping Li

Ranking is a fundamental and widely studied problem in scenarios such as search, advertising, and recommendation. However, joint optimization for multi-scenario ranking, which aims to improve the overall performance of several ranking…

Artificial Intelligence · Computer Science 2018-09-18 Jun Feng , Heng Li , Minlie Huang , Shichen Liu , Wenwu Ou , Zhirong Wang , Xiaoyan Zhu

Cooperative problems under continuous control have always been the focus of multi-agent reinforcement learning. Existing algorithms suffer from the problem of uneven learning degree with the increase of the number of agents. In this paper,…

Multiagent Systems · Computer Science 2021-07-05 Kai Liu , Yuyang Zhao , Gang Wang , Bei Peng

We consider a setting involving $N$ agents, where each agent interacts with an environment modeled as a Markov Decision Process (MDP). The agents' MDPs differ in their reward functions, capturing heterogeneous objectives/tasks. The…

Machine Learning · Computer Science 2024-09-10 Feng Zhu , Robert W. Heath , Aritra Mitra

Value-based methods of multi-agent reinforcement learning (MARL), especially the value decomposition methods, have been demonstrated on a range of challenging cooperative tasks. However, current methods pay little attention to the…

Machine Learning · Computer Science 2021-02-12 Xiaoteng Ma , Yiqin Yang , Chenghao Li , Yiwen Lu , Qianchuan Zhao , Yang Jun

Conventional Reinforcement Learning (RL) algorithms, typically focused on estimating or maximizing expected returns, face challenges when refining offline pretrained models with online experiences. This paper introduces Generative Actor…

Machine Learning · Computer Science 2025-12-29 Aoyang Qin , Deqian Kong , Wei Wang , Ying Nian Wu , Song-Chun Zhu , Sirui Xie

Actor-critic (AC) methods are ubiquitous in reinforcement learning. Although it is understood that AC methods are closely related to policy gradient (PG), their precise connection has not been fully characterized previously. In this paper,…

Artificial Intelligence · Computer Science 2021-06-15 Junfeng Wen , Saurabh Kumar , Ramki Gummadi , Dale Schuurmans

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

In cooperative stochastic games multiple agents work towards learning joint optimal actions in an unknown environment to achieve a common goal. In many real-world applications, however, constraints are often imposed on the actions that can…

Multiagent Systems · Computer Science 2020-07-14 Raghuram Bharadwaj Diddigi , Sai Koti Reddy Danda , Prabuchandran K. J. , Shalabh Bhatnagar

This paper studies a policy optimization problem arising from collaborative multi-agent reinforcement learning in a decentralized setting where agents communicate with their neighbors over an undirected graph to maximize the sum of their…

Optimization and Control · Mathematics 2022-09-07 Jinchi Chen , Jie Feng , Weiguo Gao , Ke Wei

Reinforcement learning has been proven to be highly effective in handling complex control tasks. Traditional methods typically use unimodal distributions, such as Gaussian distributions, to model the output of value distributions. However,…

Machine Learning · Computer Science 2025-07-14 Tong Liu , Yinuo Wang , Xujie Song , Wenjun Zou , Liangfa Chen , Likun Wang , Bin Shuai , Jingliang Duan , Shengbo Eben Li

Cooperative multi-agent reinforcement learning often requires decentralised policies, which severely limit the agents' ability to coordinate their behaviour. In this paper, we show that common knowledge between agents allows for complex…

Many recent successful off-policy multi-agent reinforcement learning (MARL) algorithms for cooperative partially observable environments focus on finding factorized value functions, leading to convoluted network structures. Building on the…

Machine Learning · Computer Science 2023-10-27 Raphaël Avalos , Mathieu Reymond , Ann Nowé , Diederik M. Roijers

The state-of-the-art multi-agent reinforcement learning (MARL) methods have provided promising solutions to a variety of complex problems. Yet, these methods all assume that agents perform synchronized primitive-action executions so that…

Artificial Intelligence · Computer Science 2022-10-12 Yuchen Xiao

Model-based reinforcement learning algorithms, which aim to learn a model of the environment to make decisions, are more sample efficient than their model-free counterparts. The sample efficiency of model-based approaches relies on whether…

Machine Learning · Computer Science 2021-12-21 Zhihai Wang , Jie Wang , Qi Zhou , Bin Li , Houqiang Li

Cooperative Multi-agent Reinforcement Learning (MARL) has attracted significant attention and played the potential for many real-world applications. Previous arts mainly focus on facilitating the coordination ability from different aspects…

Multiagent Systems · Computer Science 2023-05-24 Lei Yuan , Lihe Li , Ziqian Zhang , Fuxiang Zhang , Cong Guan , Yang Yu

Despite definite success in deep reinforcement learning problems, actor-critic algorithms are still confronted with sample inefficiency in complex environments, particularly in tasks where efficient exploration is a bottleneck. These…

Machine Learning · Computer Science 2021-02-09 Yannis Flet-Berliac , Johan Ferret , Olivier Pietquin , Philippe Preux , Matthieu Geist

As Large Language Model (LLM) based Multi-Agent Systems (MAS) evolve from experimental pilots to complex, persistent ecosystems, the limitations of direct agent-to-agent communication have become increasingly apparent. Current architectures…

Multiagent Systems · Computer Science 2026-05-29 Charles Fleming , Guillaume De Saint Marc , Ramana Kompella , Peter Bosch , Vijoy Pandey

We study the problem of learning multi-task, multi-agent policies for cooperative, temporal objectives, under centralized training, decentralized execution. In this setting, using automata to represent tasks enables the decomposition of…

Multiagent Systems · Computer Science 2025-11-05 Beyazit Yalcinkaya , Marcell Vazquez-Chanlatte , Ameesh Shah , Hanna Krasowski , Sanjit A. Seshia