English
Related papers

Related papers: Align on the Fly: Adapting Chatbot Behavior to Est…

200 papers

Aligning large language models (LLMs) with human intentions has become a critical task for safely deploying models in real-world systems. While existing alignment approaches have seen empirical success, theoretically understanding how these…

Machine Learning · Computer Science 2024-08-08 Shawn Im , Yixuan Li

Standard human preference-based alignment methods, such as Reinforcement Learning from Human Feedback (RLHF), are a cornerstone for aligning large language models (LLMs) with human values. However, these methods typically assume that…

Artificial Intelligence · Computer Science 2026-03-02 Xiaoyang Cao , Zelai Xu , Mo Guang , Kaiwen Long , Michiel A. Bakker , Yu Wang , Chao Yu

While Reinforcement Learning from Human Feedback (RLHF) significantly enhances the generation quality of Large Language Models (LLMs), recent studies have raised concerns regarding the complexity and instability associated with the Proximal…

Computation and Language · Computer Science 2024-02-27 Xin Mao , Feng-Lin Li , Huimin Xu , Wei Zhang , Anh Tuan Luu

Personalized preference alignment for large language models (LLMs), the process of tailoring LLMs to individual users' preferences, is an emerging research direction spanning the area of NLP and personalization. In this survey, we present…

Large Language Models (LLMs) demonstrate robust capabilities across various fields, leading to a paradigm shift in LLM-enhanced Recommender System (RS). Research to date focuses on point-wise and pair-wise recommendation paradigms, which…

Information Retrieval · Computer Science 2024-09-30 Wen-Shuo Chao , Zhi Zheng , Hengshu Zhu , Hao Liu

As large language models (LLMs) see greater use in academic and commercial settings, there is increasing interest in methods that allow language models to generate texts aligned with human preferences. In this paper, we present an initial…

Machine Learning · Computer Science 2024-06-07 Victoria Lin , Eli Ben-Michael , Louis-Philippe Morency

Recently, there has been a growing interest in leveraging Large Language Models (LLMs) for recommendation systems, which usually adapt a pre-trained LLM to the recommendation scenario through supervised fine-tuning (SFT). However, both the…

Information Retrieval · Computer Science 2024-10-17 Jiayi Liao , Xiangnan He , Ruobing Xie , Jiancan Wu , Yancheng Yuan , Xingwu Sun , Zhanhui Kang , Xiang Wang

Most Video Large Language Models (Video-LLMs) adopt preference alignment techniques, e.g., DPO~\citep{rafailov2024dpo}, to optimize the reward margin between a winning response ($y_w$) and a losing response ($y_l$). However, the likelihood…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xiaodong Wang , Jinfa Huang , Li Yuan , Peixi Peng

Reinforcement learning from human feedback (RLHF) is a promising solution to align large language models (LLMs) more closely with human values. Off-policy preference optimization, where the preference data is obtained from other models, is…

Computation and Language · Computer Science 2024-10-07 Wenxuan Zhou , Ravi Agrawal , Shujian Zhang , Sathish Reddy Indurthi , Sanqiang Zhao , Kaiqiang Song , Silei Xu , Chenguang Zhu

Large language models (LLMs) require careful alignment to balance competing objectives - factuality, safety, conciseness, proactivity, and diversity. Existing studies focus on individual techniques or specific dimensions, lacking a holistic…

Machine Learning · Computer Science 2025-09-17 Denis Janiak , Julia Moska , Dawid Motyka , Karolina Seweryn , Paweł Walkowiak , Bartosz Żuk , Arkadiusz Janz

This paper shows that alignment methods can achieve superior adherence to guardrails compared to instruction fine-tuning alone in conversational agents, also known as bots, within predefined guidelines or 'guardrails'. It examines…

Machine Learning · Computer Science 2024-06-28 Raghav Garg , Kapil Sharma , Shrey Singla

Aligning large language models with human preferences must balance two competing goals: responding helpfully to legitimate requests and reliably refusing harmful ones. Most preference-based safety alignment methods collapse safety into a…

Computation and Language · Computer Science 2026-04-22 Tiankai Yang , Yi Nian , Xinyuan Li , Ruiyao Xu , Kaize Ding , Yue Zhao

Preference learning in Large Language Models (LLMs) has advanced significantly, yet existing methods remain limited by modest performance gains, high computational costs, hyperparameter sensitivity, and insufficient modeling of global…

Computation and Language · Computer Science 2026-04-03 Liang Zhu , Yuelin Bai , Xiankun Ren , Jiaxi Yang , Lei Zhang , Feiteng Fang , Hamid Alinejad-Rokny , Minghuan Tan , Min Yang

Proximal Policy Optimization (PPO) is commonly used in Reinforcement Learning from Human Feedback to align large language models (LLMs) with downstream tasks. This paper investigates the feasibility of using PPO for direct reinforcement…

Computation and Language · Computer Science 2024-10-23 Alexander G. Padula , Dennis J. N. J. Soemers

In aligning large language models (LLMs), utilizing feedback from existing advanced AI rather than humans is an important method to scale supervisory signals. However, it is highly challenging for AI to understand human intentions and…

Computation and Language · Computer Science 2024-06-18 Rong Bao , Rui Zheng , Shihan Dou , Xiao Wang , Enyu Zhou , Bo Wang , Qi Zhang , Liang Ding , Dacheng Tao

Post-training of LLMs with RLHF, and subsequently preference optimization algorithms such as DPO, IPO, etc., made a big difference in improving human alignment. However, all such techniques can only work with a single (human) objective. In…

Machine Learning · Computer Science 2025-05-19 Akhil Agnihotri , Rahul Jain , Deepak Ramachandran , Zheng Wen

Direct Preference Optimization (DPO) has emerged as a predominant alignment method for diffusion models, facilitating off-policy training without explicit reward modeling. However, its reliance on large-scale, high-quality human preference…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Khiem Pham , Quang Nguyen , Tung Nguyen , Jingsen Zhu , Michele Santacatterina , Dimitris Metaxas , Ramin Zabih

Large language model alignment is widely used and studied to avoid LLM producing unhelpful and harmful responses. However, the lengthy training process and predefined preference bias hinder adaptation to online diverse human preferences. To…

Computation and Language · Computer Science 2024-05-02 Guanying Jiang , Lingyong Yan , Haibo Shi , Dawei Yin

Bootstrapping large language models (LLMs) through preference-based policy optimization offers a promising direction for aligning model behavior with human preferences without relying on extensive manual annotations. In this work, we…

Artificial Intelligence · Computer Science 2025-12-25 Chen Jia

Aligning large language models (LLMs) with human values and safety constraints is challenging, especially when objectives like helpfulness, truthfulness, and avoidance of harm conflict. Reinforcement Learning from Human Feedback (RLHF) has…

Computation and Language · Computer Science 2025-03-31 Xuying Li , Zhuo Li , Yuji Kosuga , Victor Bian