English
Related papers

Related papers: A Survey of Reinforcement Learning from Human Feed…

200 papers

Recent advancements in large language models (LLMs) have led to their increased application across various tasks, with reinforcement learning from human feedback (RLHF) being a crucial part of their training to align responses with user…

Computation and Language · Computer Science 2024-10-29 Ben Hauptvogel , Malte Ostendorff , Georg Rehm , Sebastian Möller

While recent advances have boosted LM proficiency in linguistic benchmarks, LMs consistently struggle to reason correctly on complex tasks like mathematics. We turn to Reinforcement Learning from Human Feedback (RLHF) as a method with which…

Computation and Language · Computer Science 2023-11-13 Sarah Pan , Vladislav Lialin , Sherin Muckatira , Anna Rumshisky

Reinforcement learning from human feedback (RLHF) is a widely used method for aligning large language models with human preferences. However, RLHF often suffers from reward model overoptimisation, in which models overfit to the reward…

Machine Learning · Computer Science 2025-09-30 Lorenz Wolf , Robert Kirk , Mirco Musolesi

Recent advancements in LLMs have shown their significant potential in tasks like text summarization and generation. Yet, they often encounter difficulty while solving complex physics problems that require arithmetic calculation and a good…

Artificial Intelligence · Computer Science 2025-01-14 Janak Kapuriya , Chhavi Kirtani , Apoorv Singh , Jay Saraf , Naman Lal , Jatin Kumar , Adarsh Raj Shivam , Astha Verma , Avinash Anand , Rajiv Ratn Shah

Recent advances in machine learning have shown that Reinforcement Learning from Human Feedback (RLHF) can improve machine learning models and align them with human preferences. Although very successful for Large Language Models (LLMs),…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Katie Z Luo , Zhenzhen Liu , Xiangyu Chen , Yurong You , Sagie Benaim , Cheng Perng Phoo , Mark Campbell , Wen Sun , Bharath Hariharan , Kilian Q. Weinberger

Reinforcement Learning from Human Feedback (RLHF) aligns language models with human preferences but is computationally expensive. We explore two approaches that leverage human gaze modeling to enhance RLHF: (1) gaze-aware reward models and…

Machine Learning · Computer Science 2025-07-17 Karim Galliamov , Ivan Titov , Ilya Pershin

Multi-Agent Reinforcement Learning (MARL) has shown promise in solving complex problems involving cooperation and competition among agents, such as an Unmanned Surface Vehicle (USV) swarm used in search and rescue, surveillance, and vessel…

Multiagent Systems · Computer Science 2025-03-10 Hyeonjun Kim , Kanghoon Lee , Junho Park , Jiachen Li , Jinkyoo Park

We provide a theoretical framework for Reinforcement Learning with Human Feedback (RLHF). Our analysis shows that when the true reward function is linear, the widely used maximum likelihood estimator (MLE) converges under both the…

Machine Learning · Computer Science 2024-02-09 Banghua Zhu , Jiantao Jiao , Michael I. Jordan

Reinforcement Learning from Human Feedback (RLHF) plays a crucial role in aligning large language models (LLMs) with human values and preferences. However, the quality and stability of the trained reward model largely determine the final…

Machine Learning · Computer Science 2025-12-17 Chunjin Jian , Xinhua Zhu

Reinforcement learning from human feedback (RLHF) emerges as a promising paradigm for aligning large language models (LLMs). However, a notable challenge in RLHF is overoptimization, where beyond a certain threshold, the pursuit of higher…

Machine Learning · Computer Science 2024-01-02 Yuanzhao Zhai , Han Zhang , Yu Lei , Yue Yu , Kele Xu , Dawei Feng , Bo Ding , Huaimin Wang

Reinforcement Learning from Human Feedback (RLHF) has emerged as a pivotal technique for aligning artificial intelligence systems with human values, achieving remarkable success in fine-tuning large language models. However, existing RLHF…

Machine Learning · Computer Science 2025-03-26 Renpu Liu , Peng Wang , Donghao Li , Cong Shen , Jing Yang

To improve human-preference alignment training, current research has developed numerous preference datasets consisting of preference pairs labeled as "preferred" or "dispreferred". These preference pairs are typically used to encode human…

Computation and Language · Computer Science 2024-10-08 Chenglong Wang , Yang Gan , Yifu Huo , Yongyu Mu , Qiaozhi He , Murun Yang , Tong Xiao , Chunliang Zhang , Tongran Liu , Jingbo Zhu

Large Language Models (LLMs) often produce plausible but poorly-calibrated answers, limiting their reliability on reasoning-intensive tasks. We present Reinforcement Learning from Self-Feedback (RLSF), a post-training stage that uses the…

Computation and Language · Computer Science 2025-07-30 Carel van Niekerk , Renato Vukovic , Benjamin Matthias Ruppik , Hsien-chin Lin , Milica Gašić

As everyday use cases of large language model (LLM) AI assistants have expanded, it is becoming increasingly important to personalize responses to align to different users' preferences and goals. While reinforcement learning from human…

Machine Learning · Computer Science 2026-02-06 Hyunji Nam , Yanming Wan , Mickel Liu , Peter Ahnn , Jianxun Lian , Natasha Jaques

Fine-tuning large language models (LLMs) to align with user preferences is challenging due to the high cost of quality human annotations in Reinforcement Learning from Human Feedback (RLHF) and the generalizability limitations of AI…

How can we make models robust to even imperfect human feedback? In reinforcement learning from human feedback (RLHF), human preferences over model outputs are used to train a reward model that assigns scalar values to responses. Because…

Artificial Intelligence · Computer Science 2026-05-11 Tiffany Horter , Andrew Markham , Niki Trigoni , Serena Booth

Reinforcement Learning from Human Feedback (RLHF) aims to align language models (LMs) with human values by training reward models (RMs) on binary preferences and using these RMs to fine-tune the base LMs. Despite its importance, the…

Machine Learning · Computer Science 2024-08-21 Manon Revel , Matteo Cargnelutti , Tyna Eloundou , Greg Leppert

Recent strides in large language models (LLMs) have yielded remarkable performance, leveraging reinforcement learning from human feedback (RLHF) to significantly enhance generation and alignment capabilities. However, RLHF encounters…

Computation and Language · Computer Science 2024-05-31 Kuo Liao , Shuang Li , Meng Zhao , Liqun Liu , Mengge Xue , Zhenyu Hu , Honglin Han , Chengguo Yin

Conversational recommender systems (CRS) based on Large Language Models (LLMs) need to constantly be aligned to the user preferences to provide satisfying and context-relevant item recommendations. The traditional supervised fine-tuning…

Machine Learning · Computer Science 2025-08-08 Zhongheng Yang , Aijia Sun , Yushang Zhao , Yinuo Yang , Dannier Li , Chengrui Zhou

This paper focuses on a critical challenge in robotics: translating text-driven human motions into executable actions for humanoid robots, enabling efficient and cost-effective learning of new behaviors. While existing text-to-motion…