English
Related papers

Related papers: The Perils of Optimizing Learned Reward Functions:…

200 papers

No-regret learning dynamics ensure that a learner asymptotically achieves an average reward no worse than that of any fixed strategy. This no-regret guarantee does not determine the value of the asymptotic average reward. Indeed, it is…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Hassan Abdelraouf , Jeff S. Shamma

The success of Reinforcement Learning from Human Feedback (RLHF) in language model alignment is critically dependent on the capability of the reward model (RM). However, as the training process progresses, the output distribution of the…

Machine Learning · Computer Science 2024-05-02 Shihan Dou , Yan Liu , Enyu Zhou , Tianlong Li , Haoxiang Jia , Limao Xiong , Xin Zhao , Junjie Ye , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Model-based reinforcement learning (MBRL) has been shown to be a powerful framework for data-efficiently learning control of continuous tasks. Recent work in MBRL has mostly focused on using more advanced function approximators and planning…

Machine Learning · Computer Science 2021-04-20 Nathan Lambert , Brandon Amos , Omry Yadan , Roberto Calandra

We study learning algorithms when there is a mismatch between the distributions of the training and test datasets of a learning algorithm. The effect of this mismatch on the generalization error and model misspecification are quantified.…

Information Theory · Computer Science 2022-08-11 Saeed Masiha , Amin Gohari , Mohammad Hossein Yassaee , Mohammad Reza Aref

Despite rapid progress in theoretical reinforcement learning (RL) over the last few years, most of the known guarantees are worst-case in nature, failing to take advantage of structure that may be known a priori about a given RL problem at…

Machine Learning · Computer Science 2021-10-26 Noah Golowich , Ankur Moitra

We study online reinforcement learning for finite-horizon deterministic control systems with {\it arbitrary} state and action spaces. Suppose that the transition dynamics and reward function is unknown, but the state and action space is…

Machine Learning · Computer Science 2019-05-07 Lin F. Yang , Chengzhuo Ni , Mengdi Wang

Reinforcement learning often suffer from the sparse reward issue in real-world robotics problems. Learning from demonstration (LfD) is an effective way to eliminate this problem, which leverages collected expert data to aid online learning.…

Robotics · Computer Science 2023-03-09 Yanjiang Guo , Jingyue Gao , Zheng Wu , Chengming Shi , Jianyu Chen

Collecting high-quality preference datasets for reinforcement learning from human feedback (RLHF) is resource-intensive and challenging. As a result, researchers often train reward models on extensive offline datasets which aggregate…

Machine Learning · Computer Science 2024-12-17 Shambhavi Krishna , Aishwarya Sahoo

Reinforcement Learning (RL) agents require the specification of a reward signal for learning behaviours. However, introduction of corrupt or stochastic rewards can yield high variance in learning. Such corruption may be a direct result of…

Machine Learning · Computer Science 2018-11-09 Joshua Romoff , Peter Henderson , Alexandre Piché , Vincent Francois-Lavet , Joelle Pineau

The reward signal plays a central role in defining the desired behaviors of agents in reinforcement learning (RL). Rewards collected from realistic environments could be perturbed, corrupted, or noisy due to an adversary, sensor error, or…

Machine Learning · Computer Science 2025-03-12 Xi Chen , Zhihui Zhu , Andrew Perrault

We consider reinforcement learning (RL) in Markov Decision Processes in which an agent repeatedly interacts with an environment that is modeled by a controlled Markov process. At each time step $t$, it earns a reward, and also incurs a…

Machine Learning · Computer Science 2023-03-16 Rahul Singh , Abhishek Gupta , Ness B. Shroff

Foundation models, specifically Large Language Models (LLMs), have lately gained wide-spread attention and adoption. Reinforcement Learning with Human Feedback (RLHF) involves training a reward model to capture desired behaviors, which is…

Computation and Language · Computer Science 2024-01-25 Will LeVine , Benjamin Pikus , Anthony Chen , Sean Hendryx

We study the distribution of regret in stochastic multi-armed bandits and episodic reinforcement learning through a unified framework. We formalize a distributional regret bound as a probabilistic guarantee that holds uniformly over all…

Machine Learning · Computer Science 2026-05-08 Harin Lee , Min-hwan Oh

Strong worst-case performance bounds for episodic reinforcement learning exist but fortunately in practice RL algorithms perform much better than such bounds would predict. Algorithms and theory that provide strong problem-dependent bounds…

Machine Learning · Computer Science 2019-11-05 Andrea Zanette , Emma Brunskill

Crucial performance metrics of a caching algorithm include its ability to quickly and accurately learn a popularity distribution of requests. However, a majority of work on analytical performance analysis focuses on hit probability after an…

Networking and Internet Architecture · Computer Science 2020-04-02 Archana Bura , Desik Rengarajan , Dileep Kalathil , Srinivas Shakkottai , Jean-Francois Chamberland-Tremblay

Policy learning in modern operations environments faces a fundamental tension between limited operational data and the large, often continuous, state and action spaces over which good decisions must be identified and deployed. We study…

Optimization and Control · Mathematics 2026-05-27 Shengbo Wang , Jose Blanchet , Peter Glynn

Human-designed reward functions for reinforcement learning (RL) agents are frequently misaligned with the humans' true, unobservable objectives, and thus act only as proxies. Optimizing for a misspecified proxy reward function often induces…

Artificial Intelligence · Computer Science 2026-01-30 Stephane Hatgis-Kessell , Logan Mondal Bhamidipaty , Emma Brunskill

We study reinforcement learning in stochastic path (SP) problems. The goal in these problems is to maximize the expected sum of rewards until the agent reaches a terminal state. We provide the first regret guarantees in this general problem…

Machine Learning · Computer Science 2022-10-18 Christoph Dann , Chen-Yu Wei , Julian Zimmert

In reinforcement learning (RL), agents continually interact with the environment and use the feedback to refine their behavior. To guide policy optimization, reward models are introduced as proxies of the desired objectives, such that when…

Machine Learning · Computer Science 2025-06-19 Rui Yu , Shenghua Wan , Yucen Wang , Chen-Xiao Gao , Le Gan , Zongzhang Zhang , De-Chuan Zhan

The success of reinforcement learning (RL) crucially depends on effective function approximation when dealing with complex ground-truth models. Existing sample-efficient RL algorithms primarily employ three approaches to function…

Machine Learning · Computer Science 2024-01-09 Yunfan Li , Lin Yang