English
Related papers

Related papers: From Non-Identifiability to Goal-Integrated Decisi…

200 papers

We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has…

Machine Learning · Computer Science 2021-12-20 Franck Djeumou , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent…

Machine Learning · Computer Science 2023-01-04 Franck Djeumou , Christian Ellis , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Inverse problems occur in a variety of parameter identification tasks in engineering. Such problems are challenging in practice, as they require repeated evaluation of computationally expensive forward models. We introduce a unifying…

Optimization and Control · Mathematics 2022-05-02 Simon Weissmann , Ashia Wilson , Jakob Zech

The choice of the parameter value for regularized inverse problems is critical to the results and remains a topic of interest. This article explores a criterion for selecting a good parameter value by maximizing the probability of the data,…

Numerical Analysis · Mathematics 2020-02-11 Toby Sanders , Rodrigo B. Platte , Robert D. Skeel

While Reinforcement Learning (RL) aims to train an agent from a reward function in a given environment, Inverse Reinforcement Learning (IRL) seeks to recover the reward function from observing an expert's behavior. It is well known that, in…

Machine Learning · Computer Science 2022-10-14 Paul Rolland , Luca Viano , Norman Schuerhoff , Boris Nikolov , Volkan Cevher

The goal of inverse reinforcement learning (IRL) is to infer a reward function that explains the behavior of an agent performing a task. The assumption that most approaches make is that the demonstrated behavior is near-optimal. In many…

Machine Learning · Computer Science 2020-11-20 Luis Haug , Ivan Ovinnikov , Eugene Bykovets

Learning invariant representations is a critical first step in a number of machine learning tasks. A common approach corresponds to the so-called information bottleneck principle in which an application dependent function of mutual…

Machine Learning · Computer Science 2021-02-17 Aditya Kumar Akash , Vishnu Suresh Lokhande , Sathya N. Ravi , Vikas Singh

Behavior of neural networks is irremediably determined by the specific loss and data used during training. However it is often desirable to tune the model at inference time based on external factors such as preferences of the user or…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Matteo Maggioni , Thomas Tanay , Francesca Babiloni , Steven McDonagh , Aleš Leonardis

Dynamical models identified from data are frequently employed in control system design. However, decoupling system identification from controller synthesis can result in situations where no suitable controller exists after a model has been…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Sampath Kumar Mulagaleti , Alberto Bemporad

In many tasks, in particular in natural science, the goal is to determine hidden system parameters from a set of measurements. Often, the forward process from parameter- to measurement-space is a well-defined function, whereas the inverse…

The gloabal objective of inverse Reinforcement Learning (IRL) is to estimate the unknown cost function of some MDP base on observed trajectories generated by (approximate) optimal policies. The classical approach consists in tuning this…

Machine Learning · Computer Science 2021-05-26 Firas Jarboui , Vianney Perchet

We present new algorithms for inverse reinforcement learning (IRL, or inverse optimal control) in convex optimization settings. We argue that finite-space IRL can be posed as a convex quadratic program under a Bayesian inference framework…

Machine Learning · Computer Science 2013-01-22 Qifeng Qiao , Peter A. Beling

Recently, data-driven techniques have demonstrated remarkable effectiveness in addressing challenges related to MR imaging inverse problems. However, these methods still exhibit certain limitations in terms of interpretability and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Huayu Wang , Chen Luo , Taofeng Xie , Qiyu Jin , Guoqing Chen , Zhuo-Xu Cui , Dong Liang

A central goal of meta-learning is to find a learning rule that enables fast adaptation across a set of tasks, by learning the appropriate inductive bias for that set. Most meta-learning algorithms try to find a \textit{global} learning…

Machine Learning · Computer Science 2020-02-11 Wonjoon Goo , Scott Niekum

In the blind deconvolution problem, we observe the convolution of an unknown filter and unknown signal and attempt to reconstruct the filter and signal. The problem seems impossible in general, since there are seemingly many more unknowns…

Information Theory · Computer Science 2021-06-15 Qingyun Sun , David Donoho

A new framework for nonlinear system identification is presented in terms of optimal fitting of stable nonlinear state space equations to input/output/state data, with a performance objective defined as a measure of robustness of the…

Optimization and Control · Mathematics 2016-11-17 Mark M. Tobenkin , Ian R. Manchester , Jennifer Wang , Alexandre Megretski , Russ Tedrake

Inverse Reinforcement Learning (IRL) is the task of learning a single reward function given a Markov Decision Process (MDP) without defining the reward function, and a set of demonstrations generated by humans/experts. However, in practice,…

Artificial Intelligence · Computer Science 2017-12-18 Siddharthan Rajasekaran , Jinwei Zhang , Jie Fu

Imitation learning (IL) provides a data-driven framework for approximating policies for large-scale combinatorial optimisation problems formulated as sequential decision problems (SDPs), where exact solution methods are computationally…

Machine Learning · Computer Science 2026-04-13 Prakash Gawas , Antoine Legrain , Louis-Martin Rousseau

This paper revisits the online learning approach to inverse linear optimization studied by B\"armann et al. (2017), where the goal is to infer an unknown linear objective function of an agent from sequential observations of the agent's…

Machine Learning · Computer Science 2025-02-11 Shinsaku Sakaue , Han Bao , Taira Tsuchiya

In this work, we propose a novel inverse reinforcement learning (IRL) algorithm for constrained Markov decision process (CMDP) problems. In standard IRL problems, the inverse learner or agent seeks to recover the reward function of the MDP,…

Machine Learning · Computer Science 2024-01-08 Nirjhar Das , Arpan Chattopadhyay