English
Related papers

Related papers: Leveraging Human Revisions for Improving Text-to-L…

200 papers

How can we make models robust to even imperfect human feedback? In reinforcement learning from human feedback (RLHF), human preferences over model outputs are used to train a reward model that assigns scalar values to responses. Because…

Artificial Intelligence · Computer Science 2026-05-11 Tiffany Horter , Andrew Markham , Niki Trigoni , Serena Booth

Large Language Models (LLMs) have made substantial strides in structured tasks through Reinforcement Learning (RL), demonstrating proficiency in mathematical reasoning and code generation. However, applying RL in broader domains like…

Computation and Language · Computer Science 2025-02-10 Hao Sun , Yunyi Shen , Jean-Francois Ton , Mihaela van der Schaar

A common and effective strategy for humans to improve an unsatisfactory outcome in daily life is to find a cause of this outcome and correct the cause. In this paper, we investigate whether this human improvement strategy can be applied to…

Machine Learning · Computer Science 2025-12-17 Shicheng Liu , Siyuan Xu , Wenjie Qiu , Hangfan Zhang , Minghui Zhu

To use reinforcement learning from human feedback (RLHF) in practical applications, it is crucial to learn reward models from diverse sources of human feedback and to consider human factors involved in providing feedback of different types.…

Machine Learning · Computer Science 2023-08-09 Yannick Metz , David Lindner , Raphaël Baur , Daniel Keim , Mennatallah El-Assady

Reinforcement Learning with Verifiable reward (RLVR) on preference data has become the mainstream approach for training Generative Reward Models (GRMs). Typically in pairwise rewarding tasks, GRMs generate reasoning chains ending with…

Computation and Language · Computer Science 2026-05-04 Zongqi Wang , Rui Wang , Yuchuan Wu , Yiyao Yu , Pinyi Zhang , Shaoning Sun , Yujiu Yang , Yongbin Li

Reinforcement Learning from Human Feedback (RLHF) aligns language models with human preferences but is computationally expensive. We explore two approaches that leverage human gaze modeling to enhance RLHF: (1) gaze-aware reward models and…

Machine Learning · Computer Science 2025-07-17 Karim Galliamov , Ivan Titov , Ilya Pershin

Recent Text-to-Image (T2I) generation models such as Stable Diffusion and Imagen have made significant progress in generating high-resolution images based on text descriptions. However, many generated images still suffer from issues such as…

Reinforcement Learning from Human Feedback (RLHF) facilitates the alignment of large language models with human preferences, significantly enhancing the quality of interactions between humans and models. InstructGPT implements RLHF through…

Computation and Language · Computer Science 2023-10-10 Zheng Yuan , Hongyi Yuan , Chuanqi Tan , Wei Wang , Songfang Huang , Fei Huang

Reinforcement Learning from Human Feedback (RLHF) has been credited as the key advance that has allowed Large Language Models (LLMs) to effectively follow instructions and produce useful assistance. Classically, this involves generating…

Machine Learning · Computer Science 2024-02-02 Alex J. Chan , Hao Sun , Samuel Holt , Mihaela van der Schaar

We present a comprehensive solution to learn and improve text-to-image models from human preference feedback. To begin with, we build ImageReward -- the first general-purpose text-to-image human preference reward model -- to effectively…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jiazheng Xu , Xiao Liu , Yuchen Wu , Yuxuan Tong , Qinkai Li , Ming Ding , Jie Tang , Yuxiao Dong

The reward model for Reinforcement Learning from Human Feedback (RLHF) has proven effective in fine-tuning Large Language Models (LLMs). Notably, collecting human feedback for RLHF can be resource-intensive and lead to scalability issues…

Computation and Language · Computer Science 2024-07-09 Jinghan Zhang , Xiting Wang , Yiqiao Jin , Changyu Chen , Xinhao Zhang , Kunpeng Liu

Reinforcement learning from human feedback (RLHF) has become an essential step in fine-tuning large language models (LLMs) to align them with human preferences. However, human labelers are selfish and have diverse preferences. They may…

Artificial Intelligence · Computer Science 2024-12-25 Shugang Hao , Lingjie Duan

Recent advances in aligning Large Language Models with human preferences have benefited from larger reward models and better preference data. However, most of these methodologies rely on the accuracy of the reward model. The reward models…

Artificial Intelligence · Computer Science 2024-11-01 Debangshu Banerjee , Aditya Gopalan

Advancements in Natural Language Processing (NLP), have led to the emergence of Large Language Models (LLMs) such as GPT, Llama, Claude, and Gemini, which excel across a range of tasks but require extensive fine-tuning to align their…

Computation and Language · Computer Science 2025-04-01 Angela Lopez-Cardona , Carlos Segura , Alexandros Karatzoglou , Sergi Abadal , Ioannis Arapakis

Reinforcement Learning from Human Feedback (RLHF) has become a popular approach to align language models (LMs) with human preferences. This method involves collecting a large dataset of human pairwise preferences across various text…

Machine Learning · Computer Science 2024-10-24 Antoine Scheid , Etienne Boursier , Alain Durmus , Michael I. Jordan , Pierre Ménard , Eric Moulines , Michal Valko

Reinforcement learning from human feedback (RLHF) has emerged as a powerful technique to make large language models (LLMs) easier to use and more effective. A core piece of the RLHF process is the training and utilization of a model of…

Computers and Society · Computer Science 2023-11-29 Nathan Lambert , Thomas Krendl Gilbert , Tom Zick

Reinforcement learning from human feedback (RLHF) has emerged as a key enabling technology for aligning AI behaviour with human preferences. The traditional way to collect data in RLHF is via pairwise comparisons: human raters are asked to…

Machine Learning · Computer Science 2025-12-01 Jan Kompatscher , Danqing Shi , Giovanna Varni , Tino Weinkauf , Antti Oulasvirta

Reinforcement learning from human feedback (RLHF) has been widely adopted to align language models (LMs) with human preference. Prior RLHF works typically take a bandit formulation, which, though intuitive, ignores the sequential nature of…

Computation and Language · Computer Science 2025-01-07 Yueqin Yin , Shentao Yang , Yujia Xie , Ziyi Yang , Yuting Sun , Hany Awadalla , Weizhu Chen , Mingyuan Zhou

The success of reinforcement learning from human feedback (RLHF) in language model alignment is strongly dependent on the quality of the underlying reward model. In this paper, we present a novel approach to improve reward model quality by…

Computation and Language · Computer Science 2024-10-28 Alizée Pace , Jonathan Mallinson , Eric Malmi , Sebastian Krause , Aliaksei Severyn

Reinforcement learning from human feedback (RLHF) is widely used to train large language models (LLMs). However, it is unclear whether LLMs accurately learn the underlying preferences in human feedback data. We coin the term \textit{Learned…

Machine Learning · Computer Science 2025-09-22 Luke Marks , Amir Abdullah , Clement Neo , Rauno Arike , David Krueger , Philip Torr , Fazl Barez