English
Related papers

Related papers: A Bayesian latent class reinforcement learning fra…

200 papers

We develop a framework for interacting with uncertain environments in reinforcement learning (RL) by leveraging preferences in the form of utility functions. We claim that there is value in considering different risk measures during…

Machine Learning · Computer Science 2021-02-23 Hannes Eriksson , Christos Dimitrakakis

Inverse reinforcement learning (IRL) is a common technique for inferring human preferences from data. Standard IRL techniques tend to assume that the human demonstrator is stationary, that is that their policy $\pi$ doesn't change over…

Machine Learning · Computer Science 2020-12-02 Harry Giles , Lawrence Chan

Reinforcement learning (RL) agents optimize only the features specified in a reward function and are indifferent to anything left out inadvertently. This means that we must not only specify what to do, but also the much larger space of what…

Machine Learning · Computer Science 2019-04-22 Rohin Shah , Dmitrii Krasheninnikov , Jordan Alexander , Pieter Abbeel , Anca Dragan

Preference-based reinforcement learning (PbRL) shows promise in aligning robot behaviors with human preferences, but its success depends heavily on the accurate modeling of human preferences through reward models. Most methods adopt…

Robotics · Computer Science 2025-03-12 Dezhong Zhao , Ruiqi Wang , Dayoon Suh , Taehyeon Kim , Ziqin Yuan , Byung-Cheol Min , Guohua Chen

Inspired by how humans combine direct interaction with action-free experience (e.g., videos), we study world models that learn from heterogeneous data. Standard world models typically rely on action-conditioned trajectories, which limits…

Machine Learning · Computer Science 2025-12-12 Marvin Alles , Xingyuan Zhang , Patrick van der Smagt , Philip Becker-Ehmck

Deep Reinforcement Learning (DRL) enables robots to learn complex behaviors through interaction with the environment. However, due to the unrestricted nature of the learning algorithms, the resulting solutions are often brittle and appear…

Robotics · Computer Science 2025-03-04 Oliver Hausdörfer , Alexander von Rohr , Éric Lefort , Angela Schoellig

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

Artificial Intelligence · Computer Science 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

This paper presents an inverse reinforcement learning~(IRL) framework for Bayesian stopping time problems. By observing the actions of a Bayesian decision maker, we provide a necessary and sufficient condition to identify if these actions…

Machine Learning · Computer Science 2023-03-29 Kunal Pattanayak , Vikram Krishnamurthy

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2022-02-18 Daniel Shin , Daniel S. Brown , Anca D. Dragan

Safety is a critical concern when deploying reinforcement learning agents for realistic tasks. Recently, safe reinforcement learning algorithms have been developed to optimize the agent's performance while avoiding violations of safety…

Machine Learning · Computer Science 2021-01-05 Baiming Chen , Zuxin Liu , Jiacheng Zhu , Mengdi Xu , Wenhao Ding , Ding Zhao

Not having access to compact and meaningful representations is known to significantly increase the complexity of reinforcement learning (RL). For this reason, it can be useful to perform state representation learning (SRL) before tackling…

Machine Learning · Computer Science 2022-02-16 Astrid Merckling , Nicolas Perrin-Gilbert , Alex Coninx , Stéphane Doncieux

Advances in the field of inverse reinforcement learning (IRL) have led to sophisticated inference frameworks that relax the original modeling assumption of observing an agent behavior that reflects only a single intention. Instead of…

Machine Learning · Computer Science 2018-12-03 Adrian Šošić , Elmar Rueckert , Jan Peters , Abdelhak M. Zoubir , Heinz Koeppl

We consider a context-dependent Reinforcement Learning (RL) setting, which is characterized by: a) an unknown finite number of not directly observable contexts; b) abrupt (discontinuous) context changes occurring during an episode; and c)…

Machine Learning · Computer Science 2022-02-15 Hang Ren , Aivar Sootla , Taher Jafferjee , Junxiao Shen , Jun Wang , Haitham Bou-Ammar

In this paper, we present an adherence-aware reinforcement learning (RL) approach aimed at seeking optimal lane-changing recommendations within a semi-autonomous driving environment to enhance a single vehicle's travel efficiency. The…

Machine Learning · Computer Science 2025-04-30 Weihao Sun , Heeseung Bang , Andreas A. Malikopoulos

Reinforcement learning (RL) systems can be complex and non-interpretable, making it challenging for non-AI experts to understand or intervene in their decisions. This is due in part to the sequential nature of RL in which actions are chosen…

Artificial Intelligence · Computer Science 2025-04-16 Amal Alabdulkarim , Madhuri Singh , Gennie Mansi , Kaely Hall , Upol Ehsan , Mark O. Riedl

Model-based reinforcement learning (MBRL) is a promising route to sample-efficient policy optimization. However, a known vulnerability of reconstruction-based MBRL consists of scenarios in which detailed aspects of the world are highly…

Machine Learning · Computer Science 2024-12-10 Miles Hutson , Isaac Kauvar , Nick Haber

Rewards and punishments in different forms are pervasive and present in a wide variety of decision-making scenarios. By observing the outcome of a sufficient number of repeated trials, one would gradually learn the value and usefulness of a…

Machine Learning · Computer Science 2019-06-25 Nikki Lijing Kuang , Clement H. C. Leung

Model-based reinforcement learning (RL) has shown great potential in various control tasks in terms of both sample-efficiency and final performance. However, learning a generalizable dynamics model robust to changes in dynamics remains a…

Machine Learning · Computer Science 2020-10-27 Younggyo Seo , Kimin Lee , Ignasi Clavera , Thanard Kurutach , Jinwoo Shin , Pieter Abbeel

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…

Beliefs are important determinants of an individual's choices and economic outcomes, so understanding how they comove and differ across individuals is of considerable interest. Researchers often rely on surveys that report individual…

Econometrics · Economics 2020-11-13 Evan Munro , Serena Ng