English
Related papers

Related papers: Multi-agent Inverse Reinforcement Learning for Two…

200 papers

One of the main challenges in imitation learning is determining what action an agent should take when outside the state distribution of the demonstrations. Inverse reinforcement learning (IRL) can enable generalization to new states by…

Machine Learning · Computer Science 2024-03-04 Daniel S. Brown , Scott Niekum , Marek Petrik

Inverse Reinforcement Learning (IRL) seeks to infer reward functions from expert demonstrations. When demonstrations originate from multiple experts with different intentions, the problem is known as Multi-Intention IRL (MI-IRL). Recent…

Machine Learning · Computer Science 2026-02-10 Antonio Mone , Frans A. Oliehoek , Luciano Cavalcante Siebert

Much of recent success in multiagent reinforcement learning has been in two-player zero-sum games. In these games, algorithms such as fictitious self-play and minimax tree search can converge to an approximate Nash equilibrium. While…

Multiagent Systems · Computer Science 2019-12-11 Alexander Shmakov , John Lanier , Stephen McAleer , Rohan Achar , Cristina Lopes , Pierre Baldi

When reward functions are hand-designed, deep reinforcement learning algorithms often suffer from reward misspecification, causing them to learn suboptimal policies in terms of the intended task objectives. In the single-agent case, inverse…

Multiagent Systems · Computer Science 2025-03-07 Nathaniel Haynam , Adam Khoja , Dhruv Kumar , Vivek Myers , Erdem Bıyık

In this work, we study an inverse reinforcement learning (IRL) problem where the experts are planning under a shared reward function but with different, unknown planning horizons. Without the knowledge of discount factors, the reward…

Machine Learning · Computer Science 2024-09-27 Jiayu Yao , Weiwei Pan , Finale Doshi-Velez , Barbara E Engelhardt

Multi-task Inverse Reinforcement Learning (IRL) is the problem of inferring multiple reward functions from expert demonstrations. Prior work, built on Bayesian IRL, is unable to scale to complex environments due to computational…

Machine Learning · Computer Science 2018-07-17 Adam Gleave , Oliver Habryka

Information theoretic sensor management approaches are an ideal solution to state estimation problems when considering the optimal control of multi-agent systems, however they are too computationally intensive for large state spaces,…

Multiagent Systems · Computer Science 2021-02-02 William A. Dawson , Ruben Glatt , Edward Rusu , Braden C. Soper , Ryan A. Goldhahn

Tremendous advances have been made in multiagent reinforcement learning (MARL). MARL corresponds to the learning problem in a multiagent system in which multiple agents learn simultaneously. It is an interdisciplinary field of study with a…

Multiagent Systems · Computer Science 2025-08-14 Yaodong Yang , Chengdong Ma , Zihan Ding , Stephen McAleer , Chi Jin , Jun Wang , Tuomas Sandholm

Recent advances in reinforcement learning have shown that language models can develop sophisticated reasoning through training on tasks with verifiable rewards, but these approaches depend on human-curated problem-answer pairs and…

Artificial Intelligence · Computer Science 2026-03-03 Bo Liu , Leon Guertler , Simon Yu , Zichen Liu , Penghui Qi , Daniel Balcells , Mickel Liu , Cheston Tan , Weiyan Shi , Min Lin , Wee Sun Lee , Natasha Jaques

Multi-agent reinforcement learning (MARL) is a prevalent learning paradigm for solving stochastic games. In most MARL studies, agents in a game are defined as teammates or enemies beforehand, and the relationships among the agents remain…

Artificial Intelligence · Computer Science 2023-03-07 Shijie Han , Siyuan Li , Bo An , Wei Zhao , Peng Liu

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of…

Machine Learning · Computer Science 2019-08-19 Daniel S. Brown , Scott Niekum

The alignment of large language models (LLMs) is crucial for generating helpful and harmless content. Existing approaches leverage preference-based human feedback data to learn the reward function and align the LLM with the feedback data.…

Machine Learning · Computer Science 2024-11-15 Yuang Cai , Yuyu Yuan , Jinsheng Shi , Qinhong Lin

The discovery of individual objectives in collective behavior of complex dynamical systems such as fish schools and bacteria colonies is a long-standing challenge. Inverse reinforcement learning is a potent approach for addressing this…

Machine Learning · Computer Science 2023-05-19 Daniel Waelchli , Pascal Weber , Petros Koumoutsakos

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

We consider a Bayesian approach to offline model-based inverse reinforcement learning (IRL). The proposed framework differs from existing offline model-based IRL approaches by performing simultaneous estimation of the expert's reward…

Machine Learning · Computer Science 2024-04-09 Ran Wei , Siliang Zeng , Chenliang Li , Alfredo Garcia , Anthony McDonald , Mingyi Hong

Recent years have witnessed significant advances in reinforcement learning (RL), which has registered great success in solving various sequential decision-making problems in machine learning. Most of the successful RL applications, e.g.,…

Machine Learning · Computer Science 2021-04-30 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

Reinforcement learning has been widely successful in producing agents capable of playing games at a human level. However, this requires complex reward engineering, and the agent's resulting policy is often unpredictable. Going beyond…

Machine Learning · Computer Science 2023-08-16 William Ahlberg , Alessandro Sestini , Konrad Tollmar , Linus Gisslén

Inverse Reinforcement Learning (IRL) is the problem of finding a reward function which describes observed/known expert behavior. The IRL setting is remarkably useful for automated control, in situations where the reward function is…

Machine Learning · Computer Science 2022-09-12 Gregory Dexter , Kevin Bello , Jean Honorio

In this paper, we study inverse game theory (resp. inverse multiagent learning) in which the goal is to find parameters of a game's payoff functions for which the expected (resp. sampled) behavior is an equilibrium. We formulate these…

Computer Science and Game Theory · Computer Science 2025-02-21 Denizalp Goktas , Amy Greenwald , Sadie Zhao , Alec Koppel , Sumitra Ganesh