English
Related papers

Related papers: Arithmetic Control of LLMs for Diverse User Prefer…

200 papers

Reinforcement learning from human feedback (RLHF) has emerged as a central framework for aligning large language models (LLMs) with human preferences. Despite its practical success, RLHF raises fundamental statistical questions because it…

Machine Learning · Statistics 2026-04-06 Pangpang Liu , Chengchun Shi , Will Wei Sun

The rapid development of large language model (LLM) alignment algorithms has resulted in a complex and fragmented landscape, with limited clarity on the effectiveness of different methods and their inter-connections. This paper introduces…

With the rapid advances in Large Language Models (LLMs), aligning LLMs with human preferences become increasingly important. Although Reinforcement Learning with Human Feedback (RLHF) proves effective, it is complicated and highly…

Computation and Language · Computer Science 2024-10-31 Shiqi Wang , Zhengze Zhang , Rui Zhao , Fei Tan , Cam Tu Nguyen

As large language models (LLMs) become increasingly embedded in everyday applications, ensuring their alignment with the diverse preferences of individual users has become a critical challenge. Currently deployed approaches typically assume…

Machine Learning · Computer Science 2024-12-19 Katarzyna Kobalczyk , Claudio Fanconi , Hao Sun , Mihaela van der Schaar

Direct Preference Optimization (DPO) has shown effectiveness in aligning multi-modal large language models (MLLM) with human preferences. However, existing methods exhibit an imbalanced responsiveness to the data of varying hardness,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Jinda Lu , Junkang Wu , Jinghan Li , Xiaojun Jia , Shuo Wang , YiFan Zhang , Junfeng Fang , Xiang Wang , Xiangnan He

ChatGLM is a free-to-use AI service powered by the ChatGLM family of large language models (LLMs). In this paper, we present the ChatGLM-RLHF pipeline -- a reinforcement learning from human feedback (RLHF) system -- designed to enhance…

Computation and Language · Computer Science 2024-04-04 Zhenyu Hou , Yilin Niu , Zhengxiao Du , Xiaohan Zhang , Xiao Liu , Aohan Zeng , Qinkai Zheng , Minlie Huang , Hongning Wang , Jie Tang , Yuxiao Dong

A critical component of the current generation of language models is preference alignment, which aims to precisely control the model's behavior to meet human needs and values. The most notable among such methods is Reinforcement Learning…

Artificial Intelligence · Computer Science 2024-10-22 Oh Joon Kwon , Daiki E. Matsunaga , Kee-Eung Kim

Reinforcement Learning from Human Feedback (RLHF) aligns language models to human preferences by employing a singular reward model derived from preference data. However, such an approach overlooks the rich diversity of human preferences…

Computation and Language · Computer Science 2024-12-30 Souradip Chakraborty , Jiahao Qiu , Hui Yuan , Alec Koppel , Furong Huang , Dinesh Manocha , Amrit Singh Bedi , Mengdi Wang

We introduce ALaRM, the first framework modeling hierarchical rewards in reinforcement learning from human feedback (RLHF), which is designed to enhance the alignment of large language models (LLMs) with human preferences. The framework…

Computation and Language · Computer Science 2024-03-19 Yuhang Lai , Siyuan Wang , Shujun Liu , Xuanjing Huang , Zhongyu Wei

Current multimodal Large Language Models (MLLMs) suffer from ``hallucination'', occasionally generating responses that are not grounded in the input images. To tackle this challenge, one promising path is to utilize reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Mengxi Zhang , Wenhao Wu , Yu Lu , Yuxin Song , Kang Rong , Huanjin Yao , Jianbo Zhao , Fanglong Liu , Yifan Sun , Haocheng Feng , Jingdong Wang

Reinforcement Learning from Human Feedback (RLHF) has been a crucial component in the recent success of Large Language Models. However, RLHF is know to exploit biases in human preferences, such as verbosity. A well-formatted and eloquent…

Computation and Language · Computer Science 2024-09-10 Ryan Park , Rafael Rafailov , Stefano Ermon , Chelsea Finn

Aligning large language models (LLMs) with human preferences is critical for enhancing LLMs' safety, helpfulness, humor, faithfulness, etc. Current reinforcement learning from human feedback (RLHF) mainly focuses on a fixed reward learned…

Machine Learning · Computer Science 2026-04-07 Qiang He , Yucheng Yang , Tianyi Zhou , Meng Fang , Mykola Pechenizkiy , Setareh Maghsudi

Reinforcement Learning (RL) in environments with complex, history-dependent reward structures poses significant challenges for traditional methods. In this work, we introduce a novel approach that leverages automaton-based feedback to guide…

Machine Learning · Computer Science 2025-10-20 Mahyar Alinejad , Alvaro Velasquez , Yue Wang , George Atia

While Reinforcement Learning from Human Feedback (RLHF) effectively aligns pretrained Large Language and Vision-Language Models (LLMs, and VLMs) with human preferences, its computational cost and complexity hamper its wider adoption. To…

Reinforcement Learning from Human Feedback (RLHF) is a widely used framework for the training of language models. However, the process of using RLHF to develop a language model that is well-aligned presents challenges, especially when it…

Computation and Language · Computer Science 2024-04-09 Bowen Qin , Duanyu Feng , Xi Yang

To improve human-preference alignment training, current research has developed numerous preference datasets consisting of preference pairs labeled as "preferred" or "dispreferred". These preference pairs are typically used to encode human…

Computation and Language · Computer Science 2024-10-08 Chenglong Wang , Yang Gan , Yifu Huo , Yongyu Mu , Qiaozhi He , Murun Yang , Tong Xiao , Chunliang Zhang , Tongran Liu , Jingbo Zhu

Reinforcement Learning with Human Feedback (RLHF) has emerged as an influential technique, enabling the alignment of large language models (LLMs) with human preferences. Despite the promising potential of RLHF, how to protect user…

Machine Learning · Computer Science 2025-02-26 Jiaming Zhang , Mingxi Lei , Meng Ding , Mengdi Li , Zihang Xiang , Difei Xu , Jinhui Xu , Di Wang

RLHF techniques like DPO can significantly improve the generation quality of text-to-image diffusion models. However, these methods optimize for a single reward that aligns model generation with population-level preferences, neglecting the…

Machine Learning · Computer Science 2025-01-14 Meihua Dang , Anikait Singh , Linqi Zhou , Stefano Ermon , Jiaming Song

How can Large Language Models (LLMs) be aligned with human intentions and values? A typical solution is to gather human preference on model outputs and finetune the LLMs accordingly while ensuring that updates do not deviate too far from a…

Computation and Language · Computer Science 2024-05-28 Hung Le , Quan Tran , Dung Nguyen , Kien Do , Saloni Mittal , Kelechi Ogueji , Svetha Venkatesh

Personalized alignment is essential for enabling large language models (LLMs) to engage effectively in user-centric dialogue. While recent prompt-based and offline optimization methods offer preliminary solutions, they fall short in…

Computation and Language · Computer Science 2025-12-12 Weixiang Zhao , Xingyu Sui , Yulin Hu , Jiahe Guo , Haixiao Liu , Biye Li , Yanyan Zhao , Bing Qin , Ting Liu