English
Related papers

Related papers: V-Learning -- A Simple, Efficient, Decentralized A…

200 papers

While Reinforcement Learning (RL) has achieved remarkable success in language modeling, its triumph hasn't yet fully translated to visuomotor agents. A primary challenge in RL models is their tendency to overfit specific tasks or…

Robotics · Computer Science 2025-08-01 Shaofei Cai , Zhancun Mu , Haiwen Xia , Bowei Zhang , Anji Liu , Yitao Liang

Significant advances have recently been achieved in Multi-Agent Reinforcement Learning (MARL) which tackles sequential decision-making problems involving multiple participants. However, MARL requires a tremendous number of samples for…

Multiagent Systems · Computer Science 2024-12-30 Xihuai Wang , Zhicheng Zhang , Weinan Zhang

In large systems, it is important for agents to learn to act effectively, but sophisticated multi-agent learning algorithms generally do not scale. An alternative approach is to find restricted classes of games where simple, efficient…

Multiagent Systems · Computer Science 2009-03-16 Ian A. Kash , Eric J. Friedman , Joseph Y. Halpern

Multi-Agent Reinforcement Learning (MARL) algorithms are widely adopted in tackling complex tasks that require collaboration and competition among agents in dynamic Multi-Agent Systems (MAS). However, learning such tasks from scratch is…

Artificial Intelligence · Computer Science 2024-02-14 Ayesha Siddika Nipu , Siming Liu , Anthony Harris

We initiate the study of Preference-Based Multi-Agent Reinforcement Learning (PbMARL), exploring both theoretical foundations and empirical validations. We define the task as identifying the Nash equilibrium from a preference-only offline…

Machine Learning · Computer Science 2025-01-10 Natalia Zhang , Xinqi Wang , Qiwen Cui , Runlong Zhou , Sham M. Kakade , Simon S. Du

Many real-world problems, such as network packet routing and urban traffic control, are naturally modeled as multi-agent reinforcement learning (RL) problems. However, existing multi-agent RL methods typically scale poorly in the problem…

Artificial Intelligence · Computer Science 2018-05-22 Jakob Foerster , Nantas Nardelli , Gregory Farquhar , Triantafyllos Afouras , Philip H. S. Torr , Pushmeet Kohli , Shimon Whiteson

In real-world multi-agent reinforcement learning (MARL) applications, agents may not have perfect state information (e.g., due to inaccurate measurement or malicious attacks), which challenges the robustness of agents' policies. Though…

Machine Learning · Computer Science 2023-08-01 Sihong He , Songyang Han , Sanbao Su , Shuo Han , Shaofeng Zou , Fei Miao

Despite remarkable achievements in single-agent offline reinforcement learning (RL), multi-agent RL (MARL) has struggled to adopt this paradigm, largely persisting with on-policy training and self-play from scratch. One reason for this gap…

Machine Learning · Computer Science 2026-03-10 Dongsu Lee , Daehee Lee , Amy Zhang

Multi-Agent Reinforcement Learning (MARL) is a branch of machine learning in which agents interact and learn optimal policies through trial and error, addressing complex scenarios where multiple agents interact and learn in the same…

Human-Computer Interaction · Computer Science 2025-12-03 Changhee Lee , Jeongmin Rhee , DongHwa Shin

Multi-agent reinforcement learning (MARL) studies crucial principles that are applicable to a variety of fields, including wireless networking and autonomous driving. We propose a photonic-based decision-making algorithm to address one of…

Machine Learning · Computer Science 2024-07-15 Shun Kotoku , Takatomo Mihana , André Röhm , Ryoichi Horisaki

Various methods for Multi-Agent Reinforcement Learning (MARL) have been developed with the assumption that agents' policies are based on accurate state information. However, policies learned through Deep Reinforcement Learning (DRL) are…

Artificial Intelligence · Computer Science 2024-04-15 Songyang Han , Sanbao Su , Sihong He , Shuo Han , Haizhao Yang , Shaofeng Zou , Fei Miao

Recent success in cooperative multi-agent reinforcement learning (MARL) relies on centralized training and policy sharing. Centralized training eliminates the issue of non-stationarity MARL yet induces large communication costs, and policy…

Multiagent Systems · Computer Science 2022-04-04 Dingyang Chen , Yile Li , Qi Zhang

The deployment of multi-agent systems in dynamic, adversarial environments like robotic soccer necessitates real-time decision-making, sophisticated cooperation, and scalable algorithms to avoid the curse of dimensionality. While…

Robotics · Computer Science 2025-12-04 Aya Taourirte , Md Sohag Mia

When solving two-player zero-sum games, multi-agent reinforcement learning (MARL) algorithms often create populations of agents where, at each iteration, a new agent is discovered as the best response to a mixture over the opponent…

Artificial Intelligence · Computer Science 2021-11-02 Xidong Feng , Oliver Slumbers , Ziyu Wan , Bo Liu , Stephen McAleer , Ying Wen , Jun Wang , Yaodong Yang

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

Multiagent Systems · Computer Science 2026-05-25 Elie Abboud , Oren Gal

Multi-agent reinforcement learning (MARL) methods, while effective in zero-sum or positive-sum games, often yield suboptimal outcomes in general-sum games where cooperation is essential for achieving globally optimal outcomes. Matrix game…

Computer Science and Game Theory · Computer Science 2024-08-09 Mustafa Yasir , Andrew Howes , Vasilios Mavroudis , Chris Hicks

In the last decade, there have been significant advances in multi-agent reinforcement learning (MARL) but there are still numerous challenges, such as high sample complexity and slow convergence to stable policies, that need to be overcome…

Artificial Intelligence · Computer Science 2023-03-02 Sriram Ganapathi Subramanian , Matthew E. Taylor , Kate Larson , Mark Crowley

Current deep reinforcement learning (RL) algorithms are still highly task-specific and lack the ability to generalize to new environments. Lifelong learning (LLL), however, aims at solving multiple tasks sequentially by efficiently…

Machine Learning · Computer Science 2021-06-15 Hadi Nekoei , Akilesh Badrinaaraayanan , Aaron Courville , Sarath Chandar

Designing efficient algorithms for multi-agent reinforcement learning (MARL) is fundamentally challenging because the size of the joint state and action spaces grows exponentially in the number of agents. These difficulties are exacerbated…

Machine Learning · Computer Science 2025-10-27 Emile Anand , Ishani Karmarkar , Guannan Qu

Multi-agent reinforcement learning (MARL) is often modeled using the framework of Markov games (also called stochastic games or dynamic games). Most of the existing literature on MARL concentrates on zero-sum Markov games but is not…

Computer Science and Game Theory · Computer Science 2022-12-20 Jayakumar Subramanian , Amit Sinha , Aditya Mahajan