English
Related papers

Related papers: Active Inverse Reward Design

200 papers

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent…

Machine Learning · Computer Science 2023-01-04 Franck Djeumou , Christian Ellis , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

When designing reinforcement learning (RL) agents, a designer communicates the desired agent behavior through the definition of reward functions - numerical feedback given to the agent as reward or punishment for its actions. However,…

Artificial Intelligence · Computer Science 2025-11-05 Michel Ma , Takuma Seno , Kaushik Subramanian , Peter R. Wurman , Peter Stone , Craig Sherstan

The problem of reward design examines the interaction between a leader and a follower, where the leader aims to shape the follower's behavior to maximize the leader's payoff by modifying the follower's reward function. Current approaches to…

Optimization and Control · Mathematics 2024-06-10 Shuo Wu , Haoxiang Ma , Jie Fu , Shuo Han

The aim of Inverse Reinforcement Learning (IRL) is to infer a reward function $R$ from a policy $\pi$. To do this, we need a model of how $\pi$ relates to $R$. In the current literature, the most common models are optimality, Boltzmann…

Machine Learning · Computer Science 2023-03-27 Joar Skalse , Alessandro Abate

One of the most interesting application scenarios in anomaly detection is when sequential data are targeted. For example, in a safety-critical environment, it is crucial to have an automatic detection system to screen the streaming data…

Machine Learning · Computer Science 2020-04-23 Min-hwan Oh , Garud Iyengar

Inverse reinforcement learning (IRL) enables an agent to learn complex behavior by observing demonstrations from a (near-)optimal policy. The typical assumption is that the learner's goal is to match the teacher's demonstrated behavior. In…

Machine Learning · Computer Science 2019-10-30 Sebastian Tschiatschek , Ahana Ghosh , Luis Haug , Rati Devidze , Adish Singla

Inverse reinforcement learning (IRL) denotes a powerful family of algorithms for recovering a reward function justifying the behavior demonstrated by an expert agent. A well-known limitation of IRL is the ambiguity in the choice of the…

Machine Learning · Computer Science 2023-04-26 Alberto Maria Metelli , Filippo Lazzati , Marcello Restelli

Item Response Theory (IRT) is a well known method for assessing responses from humans in education and psychology. In education, IRT is used to infer student abilities and characteristics of test items from student responses. Interactions…

Artificial Intelligence · Computer Science 2023-07-20 Antti Keurulainen , Isak Westerlund , Oskar Keurulainen , Andrew Howes

We introduce a novel repeated Inverse Reinforcement Learning problem: the agent has to act on behalf of a human in a sequence of tasks and wishes to minimize the number of tasks that it surprises the human by acting suboptimally with…

Artificial Intelligence · Computer Science 2017-11-07 Kareem Amin , Nan Jiang , Satinder Singh

Multi-agent inverse reinforcement learning (MIRL) can be used to learn reward functions from agents in social environments. To model realistic social dynamics, MIRL methods must account for suboptimal human reasoning and behavior.…

Artificial Intelligence · Computer Science 2021-09-06 Sage Bergerson

Shared intentionality is a critical component in developing conscious AI agents capable of collaboration, self-reflection, deliberation, and reasoning. We formulate inference of shared intentionality as an inverse reinforcement learning…

Artificial Intelligence · Computer Science 2022-07-14 Susmit Jha , John Rushby

We suggest a simple practical method to combine the human and artificial intelligence to both learn best investment practices of fund managers, and provide recommendations to improve them. Our approach is based on a combination of Inverse…

Machine Learning · Computer Science 2022-01-07 Igor Halperin , Jiayu Liu , Xiao Zhang

We consider a finite-horizon discrete-time dynamic system jointly controlled by a designer and one or more agents, where the designer can influence the agents' actions through selective information disclosure. At each time step, the…

Systems and Control · Electrical Eng. & Systems 2025-08-04 Renyan Sun , Ashutosh Nayyar

Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to…

Machine Learning · Computer Science 2019-08-19 Yue Wang , Yao Wan , Chenwei Zhang , Lixin Cui , Lu Bai , Philip S. Yu

We study inverse mechanism learning: recovering an unknown incentive-generating mechanism from observed strategic interaction traces of self-interested learning agents. Unlike inverse game theory and multi-agent inverse reinforcement…

Artificial Intelligence · Computer Science 2026-01-27 Zhiyu An , Wan Du

In computational design and fabrication, neural networks are becoming important surrogates for bulky forward simulations. A long-standing, intertwined question is that of inverse design: how to compute a design that satisfies a desired…

Graphics · Computer Science 2022-08-30 Navid Ansari , Hans-Peter Seidel , Vahid Babaei

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the…

Machine Learning · Computer Science 2020-11-19 Saurabh Arora , Prashant Doshi , Bikramjit Banerjee

Exploration in sparse reward environments remains one of the key challenges of model-free reinforcement learning. Instead of solely relying on extrinsic rewards provided by the environment, many state-of-the-art methods use intrinsic…

Machine Learning · Computer Science 2020-03-03 Roberta Raileanu , Tim Rocktäschel

We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has…

Machine Learning · Computer Science 2021-12-20 Franck Djeumou , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

For effective real-world deployment, robots should adapt to human preferences, such as balancing distance, time, and safety in delivery routing. Active preference learning (APL) learns human reward functions by presenting trajectories for…

Robotics · Computer Science 2025-07-09 Yi-Shiuan Tung , Bradley Hayes , Alessandro Roncone