English
Related papers

Related papers: ARMS: Automatic Reward Shaping for Sparse-Reward M…

200 papers

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

Optimization and Control · Mathematics 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

Much of the current work on reinforcement learning studies episodic settings, where the agent is reset between trials to an initial state distribution, often with well-shaped reward functions. Non-episodic settings, where the agent must…

Machine Learning · Computer Science 2020-06-23 John D. Co-Reyes , Suvansh Sanjeev , Glen Berseth , Abhishek Gupta , Sergey Levine

We study multi-agent reinforcement learning (MARL) in a stochastic network of agents. The objective is to find localized policies that maximize the (discounted) global reward. In general, scalability is a challenge in this setting because…

Machine Learning · Computer Science 2021-11-03 Yiheng Lin , Guannan Qu , Longbo Huang , Adam Wierman

Episodic rewards present a significant challenge in reinforcement learning. While intrinsic reward methods have demonstrated effectiveness in single-agent rein-forcement learning scenarios, their application to multi-agent reinforcement…

Artificial Intelligence · Computer Science 2025-11-24 Kesheng Chen , Wenjian Luo , Bang Zhang , Zeping Yin , Zipeng Ye

Several multiagent reinforcement learning (MARL) algorithms have been proposed to optimize agents decisions. Due to the complexity of the problem, the majority of the previously developed MARL algorithms assumed agents either had some…

Machine Learning · Computer Science 2014-01-16 Sherief Abdallah , Victor Lesser

We propose Multi Agent Reflective Policy Optimization (MARPO) to alleviate the issue of sample inefficiency in multi agent reinforcement learning. MARPO consists of two key components: a reflection mechanism that leverages subsequent…

Multiagent Systems · Computer Science 2025-12-30 Cuiling Wu , Yaozhong Gan , Junliang Xing , Ying Fu

Multi-agent reinforcement learning for incomplete information environments has attracted extensive attention from researchers. However, due to the slow sample collection and poor sample exploration, there are still some problems in…

Artificial Intelligence · Computer Science 2022-05-12 Shuhan Qi , Shuhao Zhang , Xiaohan Hou , Jiajia Zhang , Xuan Wang , Jing Xiao

Autonomous driving has attracted significant research interests in the past two decades as it offers many potential benefits, including releasing drivers from exhausting driving and mitigating traffic congestion, among others. Despite…

Machine Learning · Computer Science 2024-01-08 Wei Zhou , Dong Chen , Jun Yan , Zhaojian Li , Huilin Yin , Wanchen Ge

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

Multi-agent reinforcement learning (MARL) extends (single-agent) reinforcement learning (RL) by introducing additional agents and (potentially) partial observability of the environment. Consequently, algorithms for solving MARL problems…

Multiagent Systems · Computer Science 2019-09-12 Yilun Zhou , Derrik E. Asher , Nicholas R. Waytowich , Julie A. Shah

Microprocessor architects are increasingly resorting to domain-specific customization in the quest for high-performance and energy-efficiency. As the systems grow in complexity, fine-tuning architectural parameters across multiple…

Hardware Architecture · Computer Science 2022-11-30 Srivatsan Krishnan , Natasha Jaques , Shayegan Omidshafiei , Dan Zhang , Izzeddin Gur , Vijay Janapa Reddi , Aleksandra Faust

In this paper, we study cooperative multi-agent reinforcement learning (MARL) where the joint reward exhibits submodularity, which is a natural property capturing diminishing marginal returns when adding agents to a team. Unlike standard…

Machine Learning · Computer Science 2026-03-10 Wenjing Chen , Chengyuan Qian , Shuo Xing , Yi Zhou , Victoria Crawford

Multi-agent reinforcement learning (MARL) optimizes strategic interactions in non-cooperative dynamic games, where agents have misaligned objectives. However, data-driven methods such as multi-agent policy gradients (MA-PG) often suffer…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Jingqi Li , Gechen Qu , Jason J. Choi , Somayeh Sojoudi , Claire Tomlin

In multi-agent reinforcement learning (MARL), self-interested agents attempt to establish equilibrium and achieve coordination depending on game structure. However, existing MARL approaches are mostly bound by the simultaneous actions of…

Multiagent Systems · Computer Science 2023-12-12 Bin Zhang , Lijuan Li , Zhiwei Xu , Dapeng Li , Guoliang Fan

Multi-agent reinforcement learning (MARL) faces two critical bottlenecks distinct from single-agent RL: credit assignment in cooperative tasks and partial observability of environmental states. We propose LERO, a framework integrating Large…

Machine Learning · Computer Science 2025-03-31 Yuan Wei , Xiaohan Shan , Jianmin Li

We propose a multi-agent distributed reinforcement learning algorithm that balances between potentially conflicting short-term reward and sparse, delayed long-term reward, and learns with partial information in a dynamic environment. We…

Machine Learning · Computer Science 2022-04-06 Jing Tan , Ramin Khalili , Holger Karl

In this paper, we aim to tackle the limitation of the Adversarial Inverse Reinforcement Learning (AIRL) method in stochastic environments where theoretical results cannot hold and performance is degraded. To address this issue, we propose a…

Machine Learning · Computer Science 2026-02-12 Simon Sinong Zhan , Philip Wang , Qingyuan Wu , Yixuan Wang , Ruochen Jiao , Chao Huang , Qi Zhu

In this paper, we present a multi-agent reinforcement learning (MARL) framework for optimizing tissue repair processes using engineered biological agents. Our approach integrates: (1) stochastic reaction-diffusion systems modeling molecular…

Machine Learning · Computer Science 2025-04-16 Muhammad Al-Zafar Khan , Jamal Al-Karaki

Developing an agent capable of adapting to unseen environments remains a difficult challenge in imitation learning. This work presents Adaptive Return-conditioned Policy (ARP), an efficient framework designed to enhance the agent's…

Machine Learning · Computer Science 2023-10-26 Changyeon Kim , Younggyo Seo , Hao Liu , Lisa Lee , Jinwoo Shin , Honglak Lee , Kimin Lee

Reward shaping is effective in addressing the sparse-reward challenge in reinforcement learning (RL) by providing immediate feedback through auxiliary, informative rewards. Based on the reward shaping strategy, we propose a novel multi-task…

Machine Learning · Computer Science 2025-10-28 Haozhe Ma , Zhengding Luo , Thanh Vinh Vo , Kuankuan Sima , Tze-Yun Leong