中文
相关论文

相关论文: Sequential Anomaly Detection using Inverse Reinfor…

200 篇论文

Detection of anomalous trajectories is an important problem with potential applications to various domains, such as video surveillance, risk assessment, vessel monitoring and high-energy physics. Modeling the distribution of trajectories…

Detecting anomalies in multivariate time-series data is essential in many real-world applications. Recently, various deep learning-based approaches have shown considerable improvements in time-series anomaly detection. However, existing…

机器学习 · 计算机科学 2022-01-31 Kyeong-Joong Jeong , Yong-Min Shin

Advances in the field of inverse reinforcement learning (IRL) have led to sophisticated inference frameworks that relax the original modeling assumption of observing an agent behavior that reflects only a single intention. Instead of…

机器学习 · 计算机科学 2018-12-03 Adrian Šošić , Elmar Rueckert , Jan Peters , Abdelhak M. Zoubir , Heinz Koeppl

Inverse reinforcement learning (IRL) deals with estimating an agent's utility function from its actions. In this paper, we consider how an agent can hide its strategy and mitigate an adversarial IRL attack; we call this inverse IRL (I-IRL).…

机器学习 · 计算机科学 2022-05-24 Kunal Pattanayak , Vikram Krishnamurthy , Christopher Berry

This paper addresses the problem of inverse reinforcement learning (IRL) -- inferring the reward function of an agent from observing its behavior. IRL can provide a generalizable and compact representation for apprenticeship learning, and…

机器学习 · 计算机科学 2022-08-10 Marwa Abdulhai , Natasha Jaques , Sergey Levine

In the research area of anomaly detection, novel and promising methods are frequently developed. However, most existing studies exclusively focus on the detection task only and ignore the interpretability of the underlying models as well as…

机器学习 · 计算机科学 2023-01-16 Cheng Feng , Pingge Hu

We consider a setting for Inverse Reinforcement Learning (IRL) where the learner is extended with the ability to actively select multiple environments, observing an agent's behavior on each environment. We first demonstrate that if the…

人工智能 · 计算机科学 2016-01-26 Kareem Amin , Satinder Singh

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning…

机器学习 · 计算机科学 2018-08-15 Justin Fu , Katie Luo , Sergey Levine

Inverse reinforcement learning (IRL) seeks to learn the reward function from expert trajectories, to understand the task for imitation or collaboration thereby removing the need for manual reward engineering. However, IRL in the context of…

机器学习 · 计算机科学 2023-11-13 Yikang Gui , Prashant Doshi

We model human decision-making behaviors in a risk-taking task using inverse reinforcement learning (IRL) for the purposes of understanding real human decision making under risk. To the best of our knowledge, this is the first work applying…

机器学习 · 计算机科学 2019-06-14 Quanying Liu , Haiyan Wu , Anqi Liu

Inverse Constrained Reinforcement Learning (ICRL) is the task of inferring the implicit constraints that expert agents adhere to, based on their demonstration data. As an emerging research topic, ICRL has received considerable attention in…

机器学习 · 计算机科学 2025-02-04 Guiliang Liu , Sheng Xu , Shicheng Liu , Ashish Gaurav , Sriram Ganapathi Subramanian , Pascal Poupart

In this paper, we study an inverse reinforcement learning problem that involves learning the reward function of a learning agent using trajectory data collected while this agent is learning its optimal policy. To address this problem, we…

机器学习 · 计算机科学 2024-10-21 Kavinayan P. Sivakumar , Yi Shen , Zachary Bell , Scott Nivison , Boyuan Chen , Michael M. Zavlanos

Inverse reinforcement learning (IRL) denotes a powerful family of algorithms for recovering a reward function justifying the behavior demonstrated by an expert agent. A well-known limitation of IRL is the ambiguity in the choice of the…

机器学习 · 计算机科学 2023-04-26 Alberto Maria Metelli , Filippo Lazzati , Marcello Restelli

Inverse reinforcement learning (IRL) methods infer an agent's reward function using demonstrations of expert behavior. A Bayesian IRL approach models a distribution over candidate reward functions, capturing a degree of uncertainty in the…

机器学习 · 计算机科学 2025-07-04 Aishwarya Mandyam , Didong Li , Jiayu Yao , Diana Cai , Andrew Jones , Barbara E. Engelhardt

Standard regression techniques, while powerful, are often constrained by predefined, differentiable loss functions such as mean squared error. These functions may not fully capture the desired behavior of a system, especially when dealing…

机器学习 · 计算机科学 2025-08-04 Yongchao Huang

Inverse Reinforcement Learning (IRL) is the task of learning a single reward function given a Markov Decision Process (MDP) without defining the reward function, and a set of demonstrations generated by humans/experts. However, in practice,…

人工智能 · 计算机科学 2017-12-18 Siddharthan Rajasekaran , Jinwei Zhang , Jie Fu

Anomaly detection in time series data is important for applications in finance, healthcare, sensor networks, and industrial monitoring. Traditional methods usually struggle with limited labeled data, high false-positive rates, and…

机器学习 · 计算机科学 2025-09-01 Bahareh Golchin , Banafsheh Rekabdar , Kunpeng Liu

Inverse reinforcement learning (IRL) is the problem of inferring a reward function from expert behavior. There are several approaches to IRL, but most are designed to learn a Markovian reward. However, a reward function might be…

机器学习 · 计算机科学 2024-06-21 Noah Topper , Alvaro Velasquez , George Atia

The goal of the inverse reinforcement learning (IRL) problem is to recover the reward functions from expert demonstrations. However, the IRL problem like any ill-posed inverse problem suffers the congenital defect that the policy may be…

机器学习 · 计算机科学 2022-09-26 Ce Ju

Multi-agent learning is a promising method to simulate aggregate competitive behaviour in finance. Learning expert agents' reward functions through their external demonstrations is hence particularly relevant for subsequent design of…

机器学习 · 计算机科学 2019-06-13 Jacobo Roa-Vicens , Cyrine Chtourou , Angelos Filos , Francisco Rullan , Yarin Gal , Ricardo Silva