English
Related papers

Related papers: Multi-agent Exploration with Sub-state Entropy Est…

200 papers

Reinforcement learning algorithms struggle when the reward signal is very sparse. In these cases, naive random exploration methods essentially rely on a random walk to stumble onto a rewarding state. Recent works utilize intrinsic…

Machine Learning · Computer Science 2019-06-14 Hyoungseok Kim , Jaekyeom Kim , Yeonwoo Jeong , Sergey Levine , Hyun Oh Song

This paper presents an algorithmic framework for learning robust policies in asymmetric imperfect-information games, where the joint reward could depend on the uncertain opponent type (a private information known only to the opponent itself…

Artificial Intelligence · Computer Science 2020-03-05 Macheng Shen , Jonathan P. How

We propose a new model, independent linear Markov game, for multi-agent reinforcement learning with a large state space and a large number of agents. This is a class of Markov games with independent linear function approximation, where each…

Machine Learning · Computer Science 2023-06-23 Qiwen Cui , Kaiqing Zhang , Simon S. Du

Safe exploration is essential for the practical use of reinforcement learning (RL) in many real-world scenarios. In this paper, we present a generalized safe exploration (GSE) problem as a unified formulation of common safe exploration…

Machine Learning · Computer Science 2023-10-06 Akifumi Wachi , Wataru Hashimoto , Xun Shen , Kazumune Hashimoto

Deep reinforcement learning (DRL) faces significant challenges in addressing the hard-exploration problems in tasks with sparse or deceptive rewards and large state spaces. These challenges severely limit the practical application of DRL.…

Machine Learning · Computer Science 2024-01-03 Guojian Wang , Faguo Wu , Xiao Zhang , Ning Guo , Zhiming Zheng

In this paper, we study the cooperative Multi-Agent Reinforcement Learning (MARL) problems using Reward Machines (RMs) to specify the reward functions such that the prior knowledge of high-level events in a task can be leveraged to…

Artificial Intelligence · Computer Science 2024-03-13 Xuejing Zheng , Chao Yu

We investigate multi-agent navigation tasks, where multiple agents need to reach initially unassigned goals in a limited time. Classical planning-based methods suffer from expensive computation overhead at each step and offer limited…

Machine Learning · Computer Science 2024-12-03 Xinyi Yang , Xinting Yang , Chao Yu , Jiayu Chen , Wenbo Ding , Huazhong Yang , Yu Wang

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

Optimization and Control · Mathematics 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

In recent years Landmark Complexes have been successfully employed for localization-free and metric-free autonomous exploration using a group of sensing-limited and communication-limited robots in a GPS-denied environment. To ensure rapid…

Robotics · Computer Science 2022-09-27 Xiatao Sun , Yuwei Wu , Subhrajit Bhattacharya , Vijay Kumar

Developing reinforcement learning algorithms that satisfy safety constraints is becoming increasingly important in real-world applications. In multi-agent reinforcement learning (MARL) settings, policy optimisation with safety awareness is…

Artificial Intelligence · Computer Science 2022-02-11 Shangding Gu , Jakub Grudzien Kuba , Munning Wen , Ruiqing Chen , Ziyan Wang , Zheng Tian , Jun Wang , Alois Knoll , Yaodong Yang

Multi-Agent Reinforcement Learning (MARL) approaches have emerged as popular solutions to address the general challenges of cooperation in multi-agent environments, where the success of achieving shared or individual goals critically…

Multiagent Systems · Computer Science 2024-12-31 Reza Azadeh

In recent years, multi-agent reinforcement learning (MARL) has presented impressive performance in various applications. However, physical limitations, budget restrictions, and many other factors usually impose \textit{constraints} on a…

Machine Learning · Computer Science 2021-11-11 Zhaoxing Yang , Rong Ding , Haiming Jin , Yifei Wei , Haoyi You , Guiyun Fan , Xiaoying Gan , Xinbing Wang

We extend trust region policy optimization (TRPO) to multi-agent reinforcement learning (MARL) problems. We show that the policy update of TRPO can be transformed into a distributed consensus optimization problem for multi-agent cases. By…

Artificial Intelligence · Computer Science 2023-08-08 Hepeng Li , Haibo He

In cooperative multi-agent reinforcement learning (MARL), the environmental stochasticity and uncertainties will increase exponentially when the number of agents increases, which puts hard pressure on how to come up with a compact latent…

Multiagent Systems · Computer Science 2023-05-15 Qingpeng Zhao , Yuanyang Zhu , Zichuan Liu , Zhi Wang , Chunlin Chen

Large sequence model (SM) such as GPT series and BERT has displayed outstanding performance and generalization capabilities on vision, language, and recently reinforcement learning tasks. A natural follow-up question is how to abstract…

Multiagent Systems · Computer Science 2022-10-31 Muning Wen , Jakub Grudzien Kuba , Runji Lin , Weinan Zhang , Ying Wen , Jun Wang , Yaodong Yang

The rapid development of multimodal large language models (MLLMs) has brought significant improvements to a wide range of tasks in real-world applications. However, LLMs still exhibit certain limitations in extracting implicit semantic…

Computation and Language · Computer Science 2025-01-03 Hebin Wang , Yangning Li , Yinghui Li , Hai-Tao Zheng , Wenhao Jiang , Hong-Gee Kim

A unique challenge in Multi-Agent Reinforcement Learning (MARL) is the curse of multiagency, where the description length of the game as well as the complexity of many existing learning algorithms scale exponentially with the number of…

Machine Learning · Computer Science 2023-03-03 Yuanhao Wang , Qinghua Liu , Yu Bai , Chi Jin

In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the incorporation of…

Machine Learning · Computer Science 2025-04-04 Andre R Kuroswiski , Annie S Wu , Angelo Passaro

Designing efficient algorithms for multi-agent reinforcement learning (MARL) is fundamentally challenging because the size of the joint state and action spaces grows exponentially in the number of agents. These difficulties are exacerbated…

Machine Learning · Computer Science 2025-10-27 Emile Anand , Ishani Karmarkar , Guannan Qu

Value-decomposition methods, which reduce the difficulty of a multi-agent system by decomposing the joint state-action space into local observation-action spaces, have become popular in cooperative multi-agent reinforcement learning (MARL).…

Artificial Intelligence · Computer Science 2023-03-17 Shuhan Qi , Shuhao Zhang , Qiang Wang , Jiajia Zhang , Jing Xiao , Xuan Wang