English
Related papers

Related papers: Marginal MAP Estimation for Inverse RL under Occlu…

200 papers

One of the main challenges in imitation learning is determining what action an agent should take when outside the state distribution of the demonstrations. Inverse reinforcement learning (IRL) can enable generalization to new states by…

Machine Learning · Computer Science 2024-03-04 Daniel S. Brown , Scott Niekum , Marek Petrik

Offline reinforcement learning (RL) optimizes a policy using only a fixed dataset, making it a practical approach in scenarios where interaction with the environment is costly. Due to this limitation, generalization ability is key to…

Machine Learning · Computer Science 2025-07-04 JunHyeok Oh , Byung-Jun Lee

We consider reinforcement learning in an environment modeled by an episodic, finite, stage-dependent Markov decision process of horizon $H$ with $S$ states, and $A$ actions. The performance of an agent is measured by the regret after…

Inverse Reinforcement Learning (RL) can be used to determine the behavior of Space Objects (SOs) by estimating the reward function that an SO is using for control. The approach discussed in this work can be used to analyze maneuvering of…

Systems and Control · Electrical Eng. & Systems 2019-12-09 Bryce Doerr , Richard Linares , Roberto Furfaro

This paper presents PROB-IRM, an approach that learns robust reward machines (RMs) for reinforcement learning (RL) agents from noisy execution traces. The key aspect of RM-driven RL is the exploitation of a finite-state machine that…

Artificial Intelligence · Computer Science 2025-03-24 Roko Parac , Lorenzo Nodari , Leo Ardon , Daniel Furelos-Blanco , Federico Cerutti , Alessandra Russo

Motion planning under uncertainty is one of the main challenges in developing autonomous driving vehicles. In this work, we focus on the uncertainty in sensing and perception, resulted from a limited field of view, occlusions, and sensing…

Robotics · Computer Science 2021-10-05 Kasra Rezaee , Peyman Yadmellat , Simon Chamorro

We study inverse reinforcement learning (IRL) and imitation learning (IM), the problems of recovering a reward or policy function from expert's demonstrated trajectories. We propose a new way to improve the learning process by adding a…

Machine Learning · Computer Science 2022-08-23 The Viet Bui , Tien Mai , Patrick Jaillet

We introduce Random Reward Perturbation (RRP), a novel exploration strategy for reinforcement learning (RL). Our theoretical analyses demonstrate that adding zero-mean noise to environmental rewards effectively enhances policy diversity…

Machine Learning · Computer Science 2025-06-11 Haozhe Ma , Guoji Fu , Zhengding Luo , Jiele Wu , Tze-Yun Leong

Multi-task IRL allows for the possibility that the expert could be switching between multiple ways of solving the same problem, or interleaving demonstrations of multiple tasks. The learner aims to learn the multiple reward functions that…

Machine Learning · Computer Science 2020-04-28 Saurabh Arora , Bikramjit Banerjee , Prashant Doshi

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

We consider the problem of estimating a signal from noisy circularly-translated versions of itself, called multireference alignment (MRA). One natural approach to MRA could be to estimate the shifts of the observations first, and infer the…

Information Theory · Computer Science 2018-02-14 Tamir Bendory , Nicolas Boumal , Chao Ma , Zhizhen Zhao , Amit Singer

Most existing distance metric learning methods assume perfect side information that is usually given in pairwise or triplet constraints. Instead, in many real-world applications, the constraints are derived from side information, such as…

Machine Learning · Computer Science 2012-03-19 Kaizhu Huang , Rong Jin , Zenglin Xu , Cheng-Lin Liu

While most approaches to the problem of Inverse Reinforcement Learning (IRL) focus on estimating a reward function that best explains an expert agent's policy or demonstrated behavior on a control task, it is often the case that such…

Machine Learning · Computer Science 2020-05-01 Dexter R. R. Scobee , S. Shankar Sastry

Offline Reinforcement Learning (RL) addresses the problem of sequential decision-making by learning optimal policy through pre-collected data, without interacting with the environment. As yet, it has remained somewhat impractical, because…

Machine Learning · Computer Science 2024-10-07 Maksim Bobrin , Nazar Buzun , Dmitrii Krylov , Dmitry V. Dylov

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

Real-time optical Motion Capture (MoCap) systems have not benefited from the advances in modern data-driven modeling. In this work we apply machine learning to solve noisy unstructured marker estimates in real-time and deliver robust…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Georgios Albanis , Nikolaos Zioulis , Spyridon Thermos , Anargyros Chatzitofis , Kostas Kolomvatsos

Due to recent breakthroughs, reinforcement learning (RL) has demonstrated impressive performance in challenging sequential decision-making problems. However, an open question is how to make RL cope with partial observability which is…

Machine Learning · Computer Science 2021-04-23 Stephan Weigand , Pascal Klink , Jan Peters , Joni Pajarinen

Inverse Reinforcement Learning (IRL) has demonstrated effectiveness in a variety of imitation tasks. In this paper, we introduce an IRL framework designed to extract rewarding features from expert trajectories affected by delayed…

Machine Learning · Computer Science 2024-12-05 Simon Sinong Zhan , Qingyuan Wu , Zhian Ruan , Frank Yang , Philip Wang , Yixuan Wang , Ruochen Jiao , Chao Huang , Qi Zhu

We study the inverse problem of estimating a field $u$ from data comprising a finite set of nonlinear functionals of $u$, subject to additive noise; we denote this observed data by $y$. Our interest is in the reconstruction of piecewise…

Numerical Analysis · Mathematics 2016-09-13 Matthew M. Dunlop , Andrew M. Stuart

When recovering an unknown signal from noisy measurements, the computational difficulty of performing optimal Bayesian MMSE (minimum mean squared error) inference often necessitates the use of maximum a posteriori (MAP) inference, a special…

Machine Learning · Statistics 2016-09-23 Madhu Advani , Surya Ganguli