English
Related papers

Related papers: Sequential Anomaly Detection using Inverse Reinfor…

200 papers

The aim of Inverse Reinforcement Learning (IRL) is to infer a reward function $R$ from a policy $\pi$. To do this, we need a model of how $\pi$ relates to $R$. In the current literature, the most common models are optimality, Boltzmann…

Machine Learning · Computer Science 2023-03-27 Joar Skalse , Alessandro Abate

Accurate driving behavior modeling is fundamental to safe and efficient trajectory prediction, yet remains challenging in complex traffic scenarios. This paper presents a novel Inverse Reinforcement Learning (IRL) framework that captures…

Machine Learning · Computer Science 2026-02-06 Wenyun Li , Wenjie Huang , Zejian Deng , Chen Sun

We propose a new method for event extraction (EE) task based on an imitation learning framework, specifically, inverse reinforcement learning (IRL) via generative adversarial network (GAN). The GAN estimates proper rewards according to the…

Computation and Language · Computer Science 2018-04-24 Tongtao Zhang , Heng Ji

A fundamental question in neuroscience is how the brain creates an internal model of the world to guide actions using sequences of ambiguous sensory information. This is naturally formulated as a reinforcement learning problem under partial…

Machine Learning · Computer Science 2020-11-02 Minhae Kwon , Saurabh Daptardar , Paul Schrater , Xaq Pitkow

In this paper, we formulate inverse reinforcement learning (IRL) as an expert-learner interaction whereby the optimal performance intent of an expert or target agent is unknown to a learner agent. The learner observes the states and…

Machine Learning · Computer Science 2023-01-06 Wenqian Xue , Bosen Lian , Jialu Fan , Tianyou Chai , Frank L. Lewis

Random exploration is one of the main mechanisms through which reinforcement learning (RL) finds well-performing policies. However, it can lead to undesirable or catastrophic outcomes when learning online in safety-critical environments. In…

Machine Learning · Computer Science 2021-07-15 Djordje Grbic , Sebastian Risi

The literature on Inverse Reinforcement Learning (IRL) typically assumes that humans take actions in order to minimize the expected value of a cost function, i.e., that humans are risk neutral. Yet, in practice, humans are often far from…

Artificial Intelligence · Computer Science 2018-03-23 Sumeet Singh , Jonathan Lacotte , Anirudha Majumdar , Marco Pavone

The discovery of individual objectives in collective behavior of complex dynamical systems such as fish schools and bacteria colonies is a long-standing challenge. Inverse reinforcement learning is a potent approach for addressing this…

Machine Learning · Computer Science 2023-05-19 Daniel Waelchli , Pascal Weber , Petros Koumoutsakos

Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their ability to adapt to changing preferences. We introduce Reward-Conditioned Reinforcement Learning…

Machine Learning · Computer Science 2026-05-20 Michal Nauman , Marek Cygan , Pieter Abbeel

The detection of anomalies in time series data is a critical task with many monitoring applications. Existing systems often fail to encompass an end-to-end detection process, to facilitate comparative analysis of various anomaly detection…

Machine Learning · Computer Science 2022-04-21 Sarah Alnegheimish , Dongyu Liu , Carles Sala , Laure Berti-Equille , Kalyan Veeramachaneni

This paper focuses on the development of an online inverse reinforcement learning (IRL) technique for a class of nonlinear systems. The developed approach utilizes observed state and input trajectories, and determines the unknown cost…

Systems and Control · Computer Science 2018-11-27 Ryan Self , Michael Harlan , Rushikesh Kamalapurkar

Anomaly detection is critical for the secure and reliable operation of industrial control systems. As our reliance on such complex cyber-physical systems grows, it becomes paramount to have automated methods for detecting anomalies,…

Machine Learning · Computer Science 2024-05-10 Mayra Macas , Chunming Wu , Walter Fuertes

With the increase in the learning capability of deep convolution-based architectures, various applications of such models have been proposed over time. In the field of anomaly detection, improvements in deep learning opened new prospects of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Jin-Ha Lee , Marcella Astrid , Muhammad Zaigham Zaheer , Seung-Ik Lee

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

Machine Learning · Computer Science 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

We present an adversarial active exploration for inverse dynamics model learning, a simple yet effective learning scheme that incentivizes exploration in an environment without any human intervention. Our framework consists of a deep…

Machine Learning · Computer Science 2020-03-18 Zhang-Wei Hong , Tsu-Jui Fu , Tzu-Yun Shann , Yi-Hsiang Chang , Chun-Yi Lee

Reinforcement learning (RL) is rapidly reaching and surpassing human-level control capabilities. However, state-of-the-art RL algorithms often require timesteps and reaction times significantly faster than human capabilities, which is…

Machine Learning · Computer Science 2025-07-29 Devdhar Patel , Hava Siegelmann

In session-based or sequential recommendation, it is important to consider a number of factors like long-term user engagement, multiple types of user-item interactions such as clicks, purchases etc. The current state-of-the-art supervised…

Machine Learning · Computer Science 2020-06-12 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

Artificial Intelligence · Computer Science 2025-12-05 Shuyuan Zhang

Anomaly detection in SDN using data flow prediction is a difficult task. This problem is included in the category of time series and regression problems. Machine learning approaches are challenging in this field due to the manual selection…

Machine Learning · Computer Science 2024-02-12 Sajjad Salem , Salman Asoudeh

Convolutional Neural Network (CNN) techniques have proven to be very useful in image-based anomaly detection applications. CNN can be used as deep features extractor where other anomaly detection techniques are applied on these features.…

Machine Learning · Computer Science 2022-08-15 Sulaiman Aburakhia , Tareq Tayeh , Ryan Myers , Abdallah Shami