English
Related papers

Related papers: Credit Assignment and Efficient Exploration based …

200 papers

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

Artificial Intelligence · Computer Science 2022-06-20 Ingy ElSayed-Aly , Lu Feng

Training a multi-agent reinforcement learning (MARL) model with a sparse reward is generally difficult because numerous combinations of interactions among agents induce a certain outcome (i.e., success or failure). Earlier studies have…

Machine Learning · Computer Science 2022-02-08 Heechang Ryu , Hayong Shin , Jinkyoo Park

Efficient exploration in multi-agent reinforcement learning (MARL) is a challenging problem when receiving only a team reward, especially in environments with sparse rewards. A powerful method to mitigate this issue involves crafting dense…

Machine Learning · Computer Science 2025-07-28 Xuefei Wu , Xiao Yin , Yuanyang Zhu , Chunlin Chen

The primary objective of Multi-Agent Pathfinding (MAPF) is to plan efficient and conflict-free paths for all agents. Traditional multi-agent path planning algorithms struggle to achieve efficient distributed path planning for multiple…

Artificial Intelligence · Computer Science 2024-07-18 Zhenyu Song , Ronghao Zheng , Senlin Zhang , Meiqin Liu

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

Machine Learning · Computer Science 2021-05-25 Shariq Iqbal , Fei Sha

We propose a unified mechanism for achieving coordination and communication in Multi-Agent Reinforcement Learning (MARL), through rewarding agents for having causal influence over other agents' actions. Causal influence is assessed using…

Exploration efficiency is a challenging problem in multi-agent reinforcement learning (MARL), as the policy learned by confederate MARL depends on the collaborative approach among multiple agents. Another important problem is the less…

Machine Learning · Computer Science 2019-12-30 Qisheng Wang , Qichao Wang

To promote cooperation in Multi-Agent Reinforcement Learning, the reward signals of all agents can be aggregated together, forming global rewards that are commonly known as the fully cooperative setting. However, global rewards are usually…

Machine Learning · Computer Science 2026-01-30 Bang Giang Le , Viet Cuong Ta

Cooperative multi-agent reinforcement learning (MARL) has made prominent progress in recent years. For training efficiency and scalability, most of the MARL algorithms make all agents share the same policy or value network. However, in many…

Machine Learning · Computer Science 2022-11-07 Mingyu Yang , Jian Zhao , Xunhan Hu , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

Information theoretic sensor management approaches are an ideal solution to state estimation problems when considering the optimal control of multi-agent systems, however they are too computationally intensive for large state spaces,…

Multiagent Systems · Computer Science 2021-02-02 William A. Dawson , Ruben Glatt , Edward Rusu , Braden C. Soper , Ryan A. Goldhahn

Offline multi-agent reinforcement learning (MARL) aims to learn effective multi-agent policies from pre-collected datasets, which is an important step toward the deployment of multi-agent systems in real-world applications. However, in…

Machine Learning · Computer Science 2023-03-02 Qi Tian , Kun Kuang , Furui Liu , Baoxiang Wang

Adversarial inverse reinforcement learning (IRL) for multi-agent task allocation (MATA) is challenged by non-stationary interactions and high-dimensional coordination. Unconstrained reward inference in these settings often leads to high…

Machine Learning · Computer Science 2026-02-10 Huilin Yin , Zhikun Yang , Linchuan Zhang , Daniel Watzenig

Exploration in multi-agent reinforcement learning is a challenging problem, especially in environments with sparse rewards. We propose a general method for efficient exploration by sharing experience amongst agents. Our proposed algorithm,…

Multiagent Systems · Computer Science 2021-05-20 Filippos Christianos , Lukas Schäfer , Stefano V. Albrecht

Integrating Large Language Models (LLMs) with external tools via multi-agent systems offers a promising new paradigm for decomposing and solving complex problems. However, training these systems remains notoriously difficult due to the…

Artificial Intelligence · Computer Science 2026-02-10 Yanming Li , Xuelin Zhang , WenJie Lu , Ziye Tang , Maodong Wu , Haotian Luo , Tongtong Wu , Zijie Peng , Hongze Mi , Yibo Feng , Naiqiang Tan , Chao Huang , Hong Chen , Li Shen

We study multi-agent reinforcement learning (MARL) in a stochastic network of agents. The objective is to find localized policies that maximize the (discounted) global reward. In general, scalability is a challenge in this setting because…

Machine Learning · Computer Science 2021-11-03 Yiheng Lin , Guannan Qu , Longbo Huang , Adam Wierman

Generalization poses a significant challenge in Multi-agent Reinforcement Learning (MARL). The extent to which an agent is influenced by unseen co-players depends on the agent's policy and the specific scenario. A quantitative examination…

Multiagent Systems · Computer Science 2023-10-12 Yuxin Chen , Chen Tang , Ran Tian , Chenran Li , Jinning Li , Masayoshi Tomizuka , Wei Zhan

Value-based methods of multi-agent reinforcement learning (MARL), especially the value decomposition methods, have been demonstrated on a range of challenging cooperative tasks. However, current methods pay little attention to the…

Machine Learning · Computer Science 2021-02-12 Xiaoteng Ma , Yiqin Yang , Chenghao Li , Yiwen Lu , Qianchuan Zhao , Yang Jun

Multiagent reinforcement learning (MARL) has attracted considerable attention due to its potential in addressing complex cooperative tasks. However, existing MARL approaches often rely on frequent exchanges of action or state information…

Machine Learning · Computer Science 2026-01-14 Zhenglong Luo , Zhiyong Chen , Aoxiang Liu , Ke Pan

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

Multiagent Systems · Computer Science 2026-05-25 Elie Abboud , Oren Gal