English
Related papers

Related papers: MM-PhyRLHF: Reinforcement Learning Framework for M…

200 papers

To use reinforcement learning from human feedback (RLHF) in practical applications, it is crucial to learn reward models from diverse sources of human feedback and to consider human factors involved in providing feedback of different types.…

Machine Learning · Computer Science 2023-08-09 Yannick Metz , David Lindner , Raphaël Baur , Daniel Keim , Mennatallah El-Assady

A key technology for the development of large language models (LLMs) involves instruction tuning that helps align the models' responses with human expectations to realize impressive learning abilities. Two major approaches for instruction…

Computation and Language · Computer Science 2023-08-03 Viet Dac Lai , Chien Van Nguyen , Nghia Trung Ngo , Thuat Nguyen , Franck Dernoncourt , Ryan A. Rossi , Thien Huu Nguyen

Personalized large language models (LLMs) are designed to tailor responses to individual user preferences. While Reinforcement Learning from Human Feedback (RLHF) is a commonly used framework for aligning LLMs with human preferences,…

Computation and Language · Computer Science 2024-12-10 Xinyu Li , Ruiyang Zhou , Zachary C. Lipton , Liu Leqi

Reinforcement learning from human feedback (RLHF) can improve the quality of large language model's (LLM) outputs by aligning them with human preferences. We propose a simple algorithm for aligning LLMs with human preferences inspired by…

Code Community Question Answering (CCQA) seeks to tackle programming-related issues, thereby boosting productivity in both software engineering and academic research. Recent advancements in Reinforcement Learning from Human Feedback (RLHF)…

Computation and Language · Computer Science 2024-06-04 Hongyu Yang , Liyang He , Min Hou , Shuanghong Shen , Rui Li , Jiahui Hou , Jianhui Ma , Junda Zhao

Training multi-modal large language models (MLLMs) that align with human intentions is a long-term challenge. Traditional score-only reward models for alignment suffer from low accuracy, weak generalization, and poor interpretability,…

Artificial Intelligence · Computer Science 2025-05-27 Jiayi Zhou , Jiaming Ji , Boyuan Chen , Jiapeng Sun , Wenqi Chen , Donghai Hong , Sirui Han , Yike Guo , Yaodong Yang

Reinforcement learning from human feedback (RLHF) is widely used to align large language models (LLMs) with human preferences. However, RLHF-trained reward models often exhibit length bias -- a systematic tendency to favor longer responses…

Computation and Language · Computer Science 2025-11-18 Hyeonji Kim , Sujeong Oh , Sanghack Lee

Reinforcement Learning from Human Feedback (RLHF) and its variants have emerged as the dominant approaches for aligning Large Language Models with human intent. While empirically effective, the theoretical generalization properties of these…

Machine Learning · Computer Science 2026-01-26 Zhaochun Li , Mingyang Yi , Yue Wang , Shisheng Cui , Yong Liu

Reinforcement learning from human feedback (RLHF) provides a principled framework for aligning AI systems with human preference data. For various reasons, e.g., personal bias, context ambiguity, lack of training, etc, human annotators may…

Machine Learning · Computer Science 2024-07-10 Alexander Bukharin , Ilgee Hong , Haoming Jiang , Zichong Li , Qingru Zhang , Zixuan Zhang , Tuo Zhao

Reinforcement Learning from Human Feedback (RLHF) has become a popular approach to align language models (LMs) with human preferences. This method involves collecting a large dataset of human pairwise preferences across various text…

Machine Learning · Computer Science 2024-10-24 Antoine Scheid , Etienne Boursier , Alain Durmus , Michael I. Jordan , Pierre Ménard , Eric Moulines , Michal Valko

With the rapid advancement of AI, software engineering increasingly relies on AI-driven approaches, particularly language models (LMs), to enhance code performance. However, the trustworthiness and reliability of LMs remain significant…

Software Engineering · Computer Science 2025-03-19 Jingzhi Gong

Reinforcement learning from human feedback (RLHF) has evolved to be one of the main methods for fine-tuning large language models (LLMs). However, existing RLHF methods are non-robust, and their performance deteriorates if the downstream…

Machine Learning · Computer Science 2025-03-04 Debmalya Mandal , Paulius Sasnauskas , Goran Radanovic

Large Language Models (LLMs) often produce plausible but poorly-calibrated answers, limiting their reliability on reasoning-intensive tasks. We present Reinforcement Learning from Self-Feedback (RLSF), a post-training stage that uses the…

Computation and Language · Computer Science 2025-07-30 Carel van Niekerk , Renato Vukovic , Benjamin Matthias Ruppik , Hsien-chin Lin , Milica Gašić

Great success has been reported using Reinforcement Learning from Human Feedback (RLHF) to align large language models, with open preference datasets enabling wider experimentation, particularly for "helpfulness" in tasks like dialogue and…

Computation and Language · Computer Science 2024-07-12 Prasann Singhal , Tanya Goyal , Jiacheng Xu , Greg Durrett

Inverse Reinforcement Learning (IRL) and Reinforcement Learning from Human Feedback (RLHF) are pivotal methodologies in reward learning, which involve inferring and shaping the underlying reward function of sequential decision-making…

Machine Learning · Computer Science 2024-10-16 Kihyun Kim , Jiawei Zhang , Asuman Ozdaglar , Pablo A. Parrilo

Recent advancements in large language models (LLMs) have led to their increased application across various tasks, with reinforcement learning from human feedback (RLHF) being a crucial part of their training to align responses with user…

Computation and Language · Computer Science 2024-10-29 Ben Hauptvogel , Malte Ostendorff , Georg Rehm , Sebastian Möller

Reinforcement Learning from Human Feedback (RLHF) is a methodology that aligns agent behavior with human preferences by integrating user feedback into the agent's training process. This paper introduces a framework that guides agent…

Artificial Intelligence · Computer Science 2026-02-10 Julia Santaniello , Matthew Russell , Benson Jiang , Donatello Sassaroli , Robert Jacob , Jivko Sinapov

The success of AI assistants based on language models (LLMs) hinges crucially on Reinforcement Learning from Human Feedback (RLHF), which enables the generation of responses more aligned with human preferences. As universal AI assistants,…

Machine Learning · Computer Science 2023-12-27 Rui Zheng , Wei Shen , Yuan Hua , Wenbin Lai , Shihan Dou , Yuhao Zhou , Zhiheng Xi , Xiao Wang , Haoran Huang , Tao Gui , Qi Zhang , Xuanjing Huang

Recently, large language models (LLMs) have achieved significant progress in automated code generation. Despite their strong instruction-following capabilities, these models frequently struggled to align with user intent in coding…

Machine Learning · Computer Science 2025-06-23 Zeyuan Li , Yangfan He , Lewei He , Jianhui Wang , Tianyu Shi , Bin Lei , Yuchen Li , Qiuwu Chen

Large language models (LLMs) excel in diverse applications but face dual challenges: generating harmful content under jailbreak attacks and over-refusal of benign queries due to rigid safety mechanisms. These issues are further complicated…

Artificial Intelligence · Computer Science 2025-11-04 Yifan Xia , Guorui Chen , Wenqian Yu , Zhijiang Li , Philip Torr , Jindong Gu