English
Related papers

Related papers: Behavior Pattern Recognition using A New Represent…

200 papers

One of the most interesting application scenarios in anomaly detection is when sequential data are targeted. For example, in a safety-critical environment, it is crucial to have an automatic detection system to screen the streaming data…

Machine Learning · Computer Science 2020-04-23 Min-hwan Oh , Garud Iyengar

We consider the problem of learning to behave optimally in a Markov Decision Process when a reward function is not specified, but instead we have access to a set of demonstrators of varying performance. We assume the demonstrators are…

Machine Learning · Computer Science 2019-08-01 Pablo Samuel Castro , Shijian Li , Daqing Zhang

Inferring a person's goal from their behavior is an important problem in applications of AI (e.g. automated assistants, recommender systems). The workhorse model for this task is the rational actor model - this amounts to assuming that…

Machine Learning · Computer Science 2019-03-15 Alexander Peysakhovich

The Inverse Reinforcement Learning (\textit{IRL}) problem has seen rapid evolution in the past few years, with important applications in domains like robotics, cognition, and health. In this work, we explore the inefficacy of current IRL…

Machine Learning · Computer Science 2022-09-28 Raeid Saqur

While Reinforcement Learning (RL) aims to train an agent from a reward function in a given environment, Inverse Reinforcement Learning (IRL) seeks to recover the reward function from observing an expert's behavior. It is well known that, in…

Machine Learning · Computer Science 2022-10-14 Paul Rolland , Luca Viano , Norman Schuerhoff , Boris Nikolov , Volkan Cevher

Inverse Reinforcement Learning (IRL) has demonstrated effectiveness in a variety of imitation tasks. In this paper, we introduce an IRL framework designed to extract rewarding features from expert trajectories affected by delayed…

Machine Learning · Computer Science 2024-12-05 Simon Sinong Zhan , Qingyuan Wu , Zhian Ruan , Frank Yang , Philip Wang , Yixuan Wang , Ruochen Jiao , Chao Huang , Qi Zhu

Inverse reinforcement learning (IRL) aims to infer an agent's preferences (represented as a reward function $R$) from their behaviour (represented as a policy $\pi$). To do this, we need a behavioural model of how $\pi$ relates to $R$. In…

Machine Learning · Computer Science 2024-03-12 Joar Skalse , Alessandro Abate

This article studies inverse reinforcement learning (IRL) for the stochastic linear-quadratic optimal control problem, where two agents are considered. A learner agent does not know the expert agent's performance cost function, but it…

Optimization and Control · Mathematics 2024-05-28 Zhongshi Sun , Guangyan Jia

For AI systems to be useful to humans, they must understand and act in accordance with our values and preferences. Since specifying preferences is a hard task, inverse reinforcement learning (IRL) aims to develop methods that allow for…

Artificial Intelligence · Computer Science 2026-05-12 Karim Abdel Sadek , Mark Bedaywi , Rhys Gould , Stuart Russell

In robotic systems, the performance of reinforcement learning depends on the rationality of predefined reward functions. However, manually designed reward functions often lead to policy failures due to inaccuracies. Inverse Reinforcement…

Robotics · Computer Science 2025-09-12 Yongkai Tian , Yirong Qi , Xin Yu , Wenjun Wu , Jie Luo

This work handles the inverse reinforcement learning (IRL) problem where only a small number of demonstrations are available from a demonstrator for each high-dimensional task, insufficient to estimate an accurate reward function. Observing…

Artificial Intelligence · Computer Science 2017-10-16 Kun Li , Joel W. Burdick

Many real-life scenarios require humans to make difficult trade-offs: do we always follow all the traffic rules or do we violate the speed limit in an emergency? These scenarios force us to evaluate the trade-off between collective rules…

Machine Learning · Computer Science 2022-02-22 Arie Glazier , Andrea Loreggia , Nicholas Mattei , Taher Rahgooy , Francesca Rossi , Brent Venable

Inverse reinforcement learning (IRL) is a powerful paradigm for uncovering the incentive structure that drives agent behavior, by inferring an unknown reward function from observed trajectories within a Markov decision process (MDP).…

Inverse reinforcement learning (IRL) is the problem of inferring a reward function from expert behavior. There are several approaches to IRL, but most are designed to learn a Markovian reward. However, a reward function might be…

Machine Learning · Computer Science 2024-06-21 Noah Topper , Alvaro Velasquez , George Atia

In this paper, we study an inverse reinforcement learning problem that involves learning the reward function of a learning agent using trajectory data collected while this agent is learning its optimal policy. To address this problem, we…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yi Shen , Zachary Bell , Scott Nivison , Boyuan Chen , Michael M. Zavlanos

Inverse reinforcement learning (IRL) is an imitation learning approach to learning reward functions from expert demonstrations. Its use avoids the difficult and tedious procedure of manual reward specification while retaining the…

Machine Learning · Computer Science 2024-03-25 Daulet Baimukashev , Gokhan Alcan , Ville Kyrki

Inverse reinforcement learning (IRL) methods assume that the expert data is generated by an agent optimizing some reward function. However, in many settings, the agent may optimize a reward function subject to some constraints, where the…

Machine Learning · Computer Science 2023-05-01 Ashish Gaurav , Kasra Rezaee , Guiliang Liu , Pascal Poupart

Our goal is to extract useful knowledge from demonstrations of behavior in sequential decision-making problems. Although it is well-known that humans commonly engage in risk-sensitive behaviors in the presence of stochasticity, most Inverse…

Machine Learning · Computer Science 2025-05-21 Filippo Lazzati , Alberto Maria Metelli

Human demonstration data is often ambiguous and incomplete, motivating imitation learning approaches that also exhibit reliable planning behavior. A common paradigm to perform planning-from-demonstration involves learning a reward function…

In adversarial environments, one side could gain an advantage by identifying the opponent's strategy. For example, in combat games, if an opponents strategy is identified as overly aggressive, one could lay a trap that exploits the…

Machine Learning · Computer Science 2021-08-03 Mark Rucker , Stephen Adams , Roy Hayes , Peter A. Beling