English
Related papers

Related papers: Reviving The Classics: Active Reward Modeling in L…

200 papers

Reinforcement learning from human feedback (RLHF) has contributed to performance improvements in large language models. To tackle its reliance on substantial amounts of human-labeled data, a successful approach is multi-task representation…

Machine Learning · Computer Science 2025-03-06 Ruitao Chen , Liwei Wang

Text classification models are typically trained via supervised fine-tuning (SFT). However, SFT essentially performs behavior cloning from instance-wise labels and thus fails to adequately capture relative preference relations among…

Machine Learning · Computer Science 2026-05-19 Tianxiang Xu , Xiaoyan Zhu , Xin Lai , Jiayin Wang

We propose a novel reinforcement learning framework for post training large language models that does not rely on human in the loop feedback. Instead, our approach uses cross attention signals within the model itself to derive a self…

Artificial Intelligence · Computer Science 2025-04-18 Andrew Kiruluta , Andreas Lemos , Priscilla Burity

Aligning large language models (LLMs) with human values and intents critically involves the use of human or AI feedback. While dense feedback annotations are expensive to acquire and integrate, sparse feedback presents a structural design…

Machine Learning · Computer Science 2024-02-07 Hritik Bansal , John Dang , Aditya Grover

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

Computation and Language · Computer Science 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

This paper addresses the cost-efficiency aspect of Reinforcement Learning from Human Feedback (RLHF). RLHF leverages datasets of human preferences over outputs of large language models (LLM)s to instill human expectations into LLMs.…

Machine Learning · Computer Science 2024-12-13 Guoxi Zhang , Jiuding Duan

Reinforcement learning has seen wide success in finetuning large language models to better align with instructions via human feedback. The so-called algorithm, Reinforcement Learning with Human Feedback (RLHF) demonstrates impressive…

Computation and Language · Computer Science 2023-02-13 Tianjun Zhang , Fangchen Liu , Justin Wong , Pieter Abbeel , Joseph E. Gonzalez

Reinforcement Learning from Human Feedback (RLHF) is a pivotal technique that aligns language models closely with human-centric values. The initial phase of RLHF involves learning human values using a reward model from ranking data. It is…

Machine Learning · Computer Science 2024-01-30 Banghua Zhu , Michael I. Jordan , Jiantao Jiao

The utility of reinforcement learning is limited by the alignment of reward functions with the interests of human stakeholders. One promising method for alignment is to learn the reward function from human-generated preferences between…

Machine Learning · Computer Science 2023-09-08 W. Bradley Knox , Stephane Hatgis-Kessell , Serena Booth , Scott Niekum , Peter Stone , Alessandro Allievi

Reinforcement Learning (RL) has emerged as a transformative approach for aligning and enhancing Large Language Models (LLMs), addressing critical challenges in instruction following, ethical alignment, and reasoning capabilities. This…

Artificial Intelligence · Computer Science 2025-07-08 Saksham Sahai Srivastava , Vaneet Aggarwal

Reinforcement Learning from Human Feedback (RLHF) aligns language models with human preferences but is computationally expensive. We explore two approaches that leverage human gaze modeling to enhance RLHF: (1) gaze-aware reward models and…

Machine Learning · Computer Science 2025-07-17 Karim Galliamov , Ivan Titov , Ilya Pershin

Reinforcement learning from human feedback (RLHF) is a popular strategy for aligning large language models (LLMs) with desired behaviors. Reward modeling is a crucial step in RLHF. However, collecting paired preference data for training…

Computation and Language · Computer Science 2024-10-08 Tzu-Han Lin , Chen-An Li , Hung-yi Lee , Yun-Nung Chen

In the context of reinforcement learning from human feedback (RLHF), the reward function is generally derived from maximum likelihood estimation of a random utility model based on pairwise comparisons made by humans. The problem of learning…

Computer Science and Game Theory · Computer Science 2024-11-08 Luise Ge , Daniel Halpern , Evi Micha , Ariel D. Procaccia , Itai Shapira , Yevgeniy Vorobeychik , Junlin Wu

Reinforcement Learning from Human feedback (RLHF) has become a powerful tool to fine-tune or train agentic machine learning models. Similar to how humans interact in social contexts, we can use many types of feedback to communicate our…

Machine Learning · Computer Science 2025-02-21 Yannick Metz , David Lindner , Raphaël Baur , Mennatallah El-Assady

To design rewards that align with human goals, Reinforcement Learning from Human Feedback (RLHF) has emerged as a prominent technique for learning reward functions from human preferences and optimizing policies via reinforcement learning…

Machine Learning · Computer Science 2025-05-14 Taehyun Cho , Seokhun Ju , Seungyub Han , Dohyeong Kim , Kyungjae Lee , Jungwoo Lee

Reinforcement learning from human feedback (RLHF) is a variant of reinforcement learning (RL) that learns from human feedback instead of relying on an engineered reward function. Building on prior work on the related setting of…

Machine Learning · Computer Science 2025-12-30 Timo Kaufmann , Paul Weng , Viktor Bengs , Eyke Hüllermeier

Reinforcement Learning from Human Feedback significantly enhances Natural Language Processing by aligning language models with human expectations. A critical factor in this alignment is the strength of reward models used during training.…

Computation and Language · Computer Science 2024-10-17 Yanjun Chen , Dawei Zhu , Yirong Sun , Xinghao Chen , Wei Zhang , Xiaoyu Shen

The ability of reinforcement learning algorithms to learn effective policies is determined by the rewards available during training. However, for practical problems, obtaining large quantities of reward labels is often infeasible due to…

Machine Learning · Computer Science 2025-10-02 Shreyas Chaudhari , Renhao Zhang , Philip S. Thomas , Bruno Castro da Silva

The effectiveness of reinforcement learning (RL) agents in continuous control robotics tasks is mainly dependent on the design of the underlying reward function, which is highly prone to reward hacking. A misalignment between the reward…

Effectively aligning Large Language Models (LLMs) with human-centric values while preventing the degradation of abilities acquired through Pre-training and Supervised Fine-tuning (SFT) poses a central challenge in Reinforcement Learning…

Computation and Language · Computer Science 2024-05-29 Keming Lu , Bowen Yu , Fei Huang , Yang Fan , Runji Lin , Chang Zhou