English
Related papers

Related papers: Environmental-Impact Based Multi-Agent Reinforceme…

200 papers

Reinforcement learning (RL) has substantially improved the ability of large language model (LLM) agents to interact with environments and solve multi-turn tasks. However, effective agentic RL remains challenging: sparse outcome-only rewards…

Reinforcement learning (RL) and causal modelling naturally complement each other. The goal of causal modelling is to predict the effects of interventions in an environment, while the goal of reinforcement learning is to select interventions…

Machine Learning · Computer Science 2024-07-12 Oliver Schulte , Pascal Poupart

In this work, we integrate `social' interactions into the MARL setup through a user-defined relational network and examine the effects of agent-agent relations on the rise of emergent behaviors. Leveraging insights from sociology and…

Artificial Intelligence · Computer Science 2022-07-15 Hossein Haeri , Reza Ahmadzadeh , Kshitij Jerath

Efficiently adapting to new environments and changes in dynamics is critical for agents to successfully operate in the real world. Reinforcement learning (RL) based approaches typically rely on external reward feedback for adaptation.…

Machine Learning · Computer Science 2019-03-05 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Jie Tan , Chelsea Finn

Reinforcement Learning (RL) is known to be often unsuccessful in environments with sparse extrinsic rewards. A possible countermeasure is to endow RL agents with an intrinsic reward function, or 'intrinsic motivation', which rewards the…

Artificial Intelligence · Computer Science 2021-07-16 Francesco Massari , Martin Biehl , Lisa Meeden , Ryota Kanai

To achieve general intelligence, agents must learn how to interact with others in a shared environment: this is the challenge of multiagent reinforcement learning (MARL). The simplest form is independent reinforcement learning (InRL), where…

Artificial Intelligence · Computer Science 2017-11-08 Marc Lanctot , Vinicius Zambaldi , Audrunas Gruslys , Angeliki Lazaridou , Karl Tuyls , Julien Perolat , David Silver , Thore Graepel

In multi-agent systems, agents need to interact and collaborate with other agents in environments. Agent modeling is crucial to facilitate agent interactions and make adaptive cooperation strategies. However, it is challenging for agents to…

Artificial Intelligence · Computer Science 2023-10-20 Baofu Fang , Caiming Zheng , Hao Wang

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

Machine Learning · Computer Science 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Flocking is a very challenging problem in a multi-agent system; traditional flocking methods also require complete knowledge of the environment and a precise model for control. In this paper, we propose Evolutionary Multi-Agent…

Multiagent Systems · Computer Science 2022-09-14 Yunxiao Guo , Xinjia Xie , Runhao Zhao , Chenglan Zhu , Jiangting Yin , Han Long

Multi-agent reinforcement learning (MARL) extends (single-agent) reinforcement learning (RL) by introducing additional agents and (potentially) partial observability of the environment. Consequently, algorithms for solving MARL problems…

Multiagent Systems · Computer Science 2019-09-12 Yilun Zhou , Derrik E. Asher , Nicholas R. Waytowich , Julie A. Shah

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

A long-term goal of language agents is to learn and improve through their own experience, ultimately outperforming humans in complex, real-world tasks. However, training agents from experience data with reinforcement learning remains…

In human society, the conflict between self-interest and collective well-being often obstructs efforts to achieve shared welfare. Related concepts like the Tragedy of the Commons and Social Dilemmas frequently manifest in our daily lives.…

Multiagent Systems · Computer Science 2025-06-17 Yue Jin , Shuangqing Wei , Giovanni Montana

We consider multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents can be brittle because they can overfit their training partners' policies. This overfitting can produce agents that…

Artificial Intelligence · Computer Science 2022-03-08 Tessa van der Heiden , Herke van Hoof , Efstratios Gavves , Christoph Salge

Real-world digital environments are highly diverse and dynamic. These characteristics cause agents to frequently encounter unseen environments and distribution shifts, making continual learning in such environments essential for…

Computation and Language · Computer Science 2026-05-12 Tianci Xue , Zeyi Liao , Tianneng Shi , Zilu Wang , Kai Zhang , Dawn Song , Yu Su , Huan Sun

Reinforcement learning can train LLM agents from sparse task rewards, but long-horizon credit assignment remains challenging: a single success-or-failure signal must be distributed across many actions. Existing methods rely on…

Artificial Intelligence · Computer Science 2026-05-20 Xiaozhe Li , Tianyi Lyu , Yang Li , Yichuan Ma , Peiji Li , Linyang Li , Qipeng Guo , Dahua Lin , Kai Chen

This paper presents a novel approach to Multi-Agent Reinforcement Learning (MARL) that combines cooperative task decomposition with the learning of reward machines (RMs) encoding the structure of the sub-tasks. The proposed method helps…

Artificial Intelligence · Computer Science 2025-02-17 Leo Ardon , Daniel Furelos-Blanco , Alessandra Russo

The majority of Multi-Agent Reinforcement Learning (MARL) literature equates the cooperation of self-interested agents in mixed environments to the problem of social welfare maximization, allowing agents to arbitrarily share rewards and…

Multiagent Systems · Computer Science 2023-06-16 Dmitry Ivanov , Ilya Zisman , Kirill Chernyshev

In Model-Based Reinforcement Learning (MBRL), incorporating causal structures into dynamics models provides agents with a structured understanding of the environments, enabling efficient decision. Empowerment as an intrinsic motivation…

Artificial Intelligence · Computer Science 2025-02-17 Hongye Cao , Fan Feng , Meng Fang , Shaokang Dong , Tianpei Yang , Jing Huo , Yang Gao

Multi-agent inverse reinforcement learning (MIRL) can be used to learn reward functions from agents in social environments. To model realistic social dynamics, MIRL methods must account for suboptimal human reasoning and behavior.…

Artificial Intelligence · Computer Science 2021-09-06 Sage Bergerson