English
Related papers

Related papers: Anchored Preference Optimization and Contrastive R…

200 papers

Large language models (LLMs) often contain misleading content, emphasizing the need to align them with human values to ensure secure AI systems. Reinforcement learning from human feedback (RLHF) has been employed to achieve this alignment.…

Computation and Language · Computer Science 2024-02-28 Feifan Song , Bowen Yu , Minghao Li , Haiyang Yu , Fei Huang , Yongbin Li , Houfeng Wang

Alignment is a crucial step to enhance the instruction-following and conversational abilities of language models. Despite many recent work proposing new algorithms, datasets, and training pipelines, there is a lack of comprehensive studies…

Computation and Language · Computer Science 2024-10-04 Xiao Yu , Qingyang Wu , Yu Li , Zhou Yu

Existing multi-objective preference alignment methods for large language models (LLMs) face limitations: (1) the inability to effectively balance various preference dimensions, and (2) reliance on auxiliary reward/reference models…

Machine Learning · Computer Science 2025-06-10 Qi Liu , Jingqing Ruan , Hao Li , Haodong Zhao , Desheng Wang , Jiansong Chen , Wan Guanglu , Xunliang Cai , Zhi Zheng , Tong Xu

Fine-tuning large language models (LLMs) to align with human preferences has driven the success of systems such as Gemini and ChatGPT. However, approaches like Reinforcement Learning from Human Feedback (RLHF) remain computationally…

Machine Learning · Computer Science 2026-05-25 Miria Feng , Mert Pilanci

Large Language Models (LLMs) exhibit remarkably powerful capabilities. One of the crucial factors to achieve success is aligning the LLM's output with human preferences. This alignment process often requires only a small amount of data to…

Despite advances in Preference Alignment (PA) for Large Language Models (LLMs), mainstream methods like Reinforcement Learning with Human Feedback (RLHF) face notable challenges. These approaches require high-quality datasets of positive…

Machine Learning · Computer Science 2025-04-10 Xiaohua Feng , Yuyuan Li , Huwei Ji , Jiaming Zhang , Li Zhang , Tianyu Du , Chaochao Chen

The alignment of large language models (LLMs) with human preferences remains a key challenge. While post-training techniques like Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO) have achieved…

Artificial Intelligence · Computer Science 2025-07-11 Qingyu Yin , Chak Tou Leong , Minjun Zhu , Hanqi Yan , Qiang Zhang , Yulan He , Wenjie Li , Jun Wang , Yue Zhang , Linyi Yang

Large Vision-Language Models (LVLMs) or multimodal large language models represent a significant advancement in artificial intelligence, enabling systems to understand and generate content across both visual and textual modalities. While…

Machine Learning · Computer Science 2025-09-09 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Preference learning is critical for aligning large language models (LLMs) with human values, with the quality of preference datasets playing a crucial role in this process. While existing metrics primarily assess data quality based on…

Machine Learning · Computer Science 2025-03-05 Kexin Huang , Junkang Wu , Ziqian Chen , Xue Wang , Jinyang Gao , Bolin Ding , Jiancan Wu , Xiangnan He , Xiang Wang

Alignment of large language models (LLMs) involves training models on preference-contrastive output pairs to adjust their responses according to human preferences. To obtain such contrastive pairs, traditional methods like RLHF and RLAIF…

Computation and Language · Computer Science 2024-10-18 Zekun Moore Wang , Shawn Wang , Kang Zhu , Jiaheng Liu , Ke Xu , Jie Fu , Wangchunshu Zhou , Wenhao Huang

Large Language Models (LLMs) struggle with accuracy, domain-specific reasoning, and interpretability in vertical domains. Traditional preference alignment methods like Reinforcement Learning from Human Feedback (RLHF) and Direct Preference…

Computation and Language · Computer Science 2025-06-04 Qihang Yan , Xinyu Zhang , Luming Guo , Qi Zhang , Feifan Liu

Offline preference optimization methods are efficient for large language models (LLMs) alignment. Direct Preference optimization (DPO)-like learning, one of the most popular approaches, stands out for its efficiency in reward modeling.…

Machine Learning · Computer Science 2026-05-26 Xiaobo Wang , Zixia Jia , Jiaqi Li , Qi Liu , Zilong Zheng

We study the post-training of large language models (LLMs) with human preference data. Recently, direct preference optimization and its variants have shown considerable promise in aligning language models, eliminating the need for reward…

Machine Learning · Computer Science 2025-05-14 Teng Xiao , Zhen Ge , Sujay Sanghavi , Tian Wang , Julian Katz-Samuels , Marc Versage , Qingjun Cui , Trishul Chilimbi

Recent advancements in text-to-speech (TTS) have shown that language model (LM)-based systems offer competitive performance to their counterparts. Further optimization can be achieved through preference alignment algorithms, which adjust…

Computation and Language · Computer Science 2024-09-20 Jinchuan Tian , Chunlei Zhang , Jiatong Shi , Hao Zhang , Jianwei Yu , Shinji Watanabe , Dong Yu

Efficient preference optimization algorithms such as Direct Preference Optimization (DPO) have become a popular approach in aligning large language models (LLMs) with human preferences. These algorithms implicitly treat the LLM as a reward…

Computation and Language · Computer Science 2025-07-29 Tong Liu , Xiao Yu , Wenxuan Zhou , Jindong Gu , Volker Tresp

Human preference data is essential for aligning large language models (LLMs) with human values, but collecting such data is often costly and inefficient-motivating the need for efficient data selection methods that reduce annotation costs…

Computation and Language · Computer Science 2026-04-21 Seohyeong Lee , Eunwon Kim , Hwaran Lee , Buru Chang

Aligning large language models (LLMs) with human preferences is a critical challenge in AI research. While methods like Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO) are widely used, they often…

Computation and Language · Computer Science 2026-05-19 Xuan Qi , Rongwu Xu , Zhijing Jin

Large language models (LLMs) are increasingly deployed in real-world applications that require careful balancing of multiple, often conflicting, objectives, such as informativeness versus conciseness, or helpfulness versus creativity.…

Machine Learning · Computer Science 2025-08-12 Qiang He , Setareh Maghsudi

We introduce ConfPO, a method for preference learning in Large Language Models (LLMs) that identifies and optimizes preference-critical tokens based solely on the training policy's confidence, without requiring any auxiliary models or…

Computation and Language · Computer Science 2025-06-13 Hee Suk Yoon , Eunseop Yoon , Mark Hasegawa-Johnson , Sungwoong Kim , Chang D. Yoo

The field of chemistry and Artificial Intelligence (AI) intersection is an area of active research that aims to accelerate scientific discovery. The integration of large language models (LLMs) with scientific modalities has shown…

Computation and Language · Computer Science 2024-07-16 Dimitris Gkoumas