English
Related papers

Related papers: Reward Machines: Exploiting Reward Function Struct…

200 papers

We present a new model-based algorithm for reinforcement learning (RL) which consists of explicit exploration and exploitation phases, and is applicable in large or infinite state spaces. The algorithm maintains a set of dynamics models…

Machine Learning · Computer Science 2019-12-03 Mikael Henaff

Prior work has proposed a simple strategy for reinforcement learning (RL): label experience with the outcomes achieved in that experience, and then imitate the relabeled experience. These outcome-conditioned imitation learning methods are…

Machine Learning · Computer Science 2023-02-21 Benjamin Eysenbach , Soumith Udatha , Sergey Levine , Ruslan Salakhutdinov

Inverse reinforcement learning (IRL) is an imitation learning approach to learning reward functions from expert demonstrations. Its use avoids the difficult and tedious procedure of manual reward specification while retaining the…

Machine Learning · Computer Science 2024-03-25 Daulet Baimukashev , Gokhan Alcan , Ville Kyrki

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2023-01-05 Daniel Shin , Anca D. Dragan , Daniel S. Brown

Offline reinforcement learning can enable policy learning from pre-collected, sub-optimal datasets without online interactions. This makes it ideal for real-world robots and safety-critical scenarios, where collecting online data or expert…

Robotics · Computer Science 2025-08-07 Sreyas Venkataraman , Yufei Wang , Ziyu Wang , Navin Sriram Ravie , Zackory Erickson , David Held

Large language model alignment via reinforcement learning depends critically on reward function quality. However, static, domain-specific reward models are often costly to train and exhibit poor generalization in out-of-distribution…

Computation and Language · Computer Science 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Bosi Wen , Yidong Wang , Yu Luo , Hongning Wang , Minlie Huang

We study deep reinforcement learning (RL) algorithms with delayed rewards. In many real-world tasks, instant rewards are often not readily accessible or even defined immediately after the agent performs actions. In this work, we first…

Machine Learning · Computer Science 2021-06-23 Beining Han , Zhizhou Ren , Zuofan Wu , Yuan Zhou , Jian Peng

Exploration in reinforcement learning (RL) remains an open challenge. RL algorithms rely on observing rewards to train the agent, and if informative rewards are sparse the agent learns slowly or may not learn at all. To improve exploration…

Machine Learning · Computer Science 2024-11-12 Simone Parisi , Alireza Kazemipour , Michael Bowling

Reinforcement learning (RL) has been widely used in text generation to alleviate the exposure bias issue or to utilize non-parallel datasets. The reward function plays an important role in making RL training successful. However, previous…

Machine Learning · Computer Science 2023-01-19 Yongchang Hao , Yuxin Liu , Lili Mou

While reinforcement learning (RL) has been successful in natural language processing (NLP) domains such as dialogue generation and text-based games, it typically faces the problem of sparse rewards that leads to slow or no convergence.…

Computation and Language · Computer Science 2020-10-07 Ameet Deshpande , Eve Fleisig

Reinforcement learning, which acquires a policy maximizing long-term rewards, has been actively studied. Unfortunately, this learning type is too slow and difficult to use in practical situations because the state-action space becomes huge…

Machine Learning · Computer Science 2024-10-28 Takato Okudo , Seiji Yamada

Automating robotic surgery via learning from demonstration (LfD) techniques is extremely challenging. This is because surgical tasks often involve sequential decision-making processes with complex interactions of physical objects and have…

Robotics · Computer Science 2024-10-11 Zohre Karimi , Shing-Hei Ho , Bao Thach , Alan Kuntz , Daniel S. Brown

Conveying complex objectives to reinforcement learning (RL) agents can often be difficult, involving meticulous design of reward functions that are sufficiently informative yet easy enough to provide. Human-in-the-loop RL methods allow…

Machine Learning · Computer Science 2021-06-10 Kimin Lee , Laura Smith , Pieter Abbeel

While reinforcement learning (RL) demonstrated remarkable success in enhancing the reasoning capabilities of language models, the training dynamics of RL in LLMs remain unclear. In this work, we provide an explanation of the RL training…

Machine Learning · Computer Science 2025-09-30 Xingwu Chen , Tianle Li , Difan Zou

Interest in reinforcement learning (RL) for large-scale systems, comprising extensive populations of intelligent agents interacting with heterogeneous environments, has surged significantly across diverse scientific domains in recent years.…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Wei Zhang , Jr-Shin Li

The objective of a reinforcement learning agent is to behave so as to maximise the sum of a suitable scalar function of state: the reward. These rewards are typically given and immutable. In this paper, we instead consider the proposition…

Artificial Intelligence · Computer Science 2020-08-25 Zeyu Zheng , Junhyuk Oh , Matteo Hessel , Zhongwen Xu , Manuel Kroiss , Hado van Hasselt , David Silver , Satinder Singh

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

Reward functions are a common way to specify the objective of a robot. As designing reward functions can be extremely challenging, a more promising approach is to directly learn reward functions from human teachers. Importantly, data from…

Building systems that are good for society in the face of complex societal effects requires a dynamic approach. Recent approaches to machine learning (ML) documentation have demonstrated the promise of discursive frameworks for deliberation…

Machine Learning · Computer Science 2023-03-21 Thomas Krendl Gilbert , Nathan Lambert , Sarah Dean , Tom Zick , Aaron Snoswell

In reinforcement learning (RL), agents sequentially interact with changing environments while aiming to maximize the obtained rewards. Usually, rewards are observed only after acting, and so the goal is to maximize the expected cumulative…

Machine Learning · Computer Science 2024-10-15 Nadav Merlis , Dorian Baudry , Vianney Perchet