English
Related papers

Related papers: How Well Can Preference Optimization Generalize Un…

200 papers

Direct Preference Optimisation (DPO) has emerged as a powerful method for aligning Large Language Models (LLMs) with human preferences, offering a stable and efficient alternative to approaches that use Reinforcement learning via Human…

Artificial Intelligence · Computer Science 2025-05-06 Sarvesh Shashidhar , Ritik , Nachiketa Patil , Suraj Racha , Ganesh Ramakrishnan

Aligning large language models (LLMs) with human preferences has become essential for safe and beneficial AI deployment. While Reinforcement Learning from Human Feedback (RLHF) established the dominant paradigm, a proliferation of…

Artificial Intelligence · Computer Science 2026-01-13 Tarun Raheja , Nilay Pochhi

Web-scale pre-training datasets are the cornerstone of LLMs' success. However, text data curated from the Internet inevitably contains random noise caused by decoding errors or unregulated web content. In contrast to previous works that…

Computation and Language · Computer Science 2025-05-19 Jinghan Ru , Yuxin Xie , Xianwei Zhuang , Yuguo Yin , Zhihui Guo , Zhiming Liu , Qianli Ren , Yuexian Zou

Reward modelling from preference data is a crucial step in aligning large language models (LLMs) with human values, requiring robust generalisation to novel prompt-response pairs. In this work, we propose to frame this problem in a causal…

Artificial Intelligence · Computer Science 2026-05-12 Katarzyna Kobalczyk , Mihaela van der Schaar

Personalized preference alignment for large language models (LLMs), the process of tailoring LLMs to individual users' preferences, is an emerging research direction spanning the area of NLP and personalization. In this survey, we present…

In recent years, Large Language Models (LLMs) have witnessed a remarkable surge in prevalence, altering the landscape of natural language processing and machine learning. One key factor in improving the performance of LLMs is alignment with…

Computation and Language · Computer Science 2023-10-17 Keita Saito , Akifumi Wachi , Koki Wataoka , Youhei Akimoto

Recommender systems are crucial for personalizing user experiences but often depend on implicit feedback data, which can be noisy and misleading. Existing denoising studies involve incorporating auxiliary information or learning strategies…

Information Retrieval · Computer Science 2025-02-14 Shuyao Wang , Zhi Zheng , Yongduo Sui , Hui Xiong

Adopting a two-stage paradigm of pretraining followed by fine-tuning, Pretrained Language Models (PLMs) have achieved substantial advancements in the field of natural language processing. However, in real-world scenarios, data labels are…

Computation and Language · Computer Science 2023-11-03 Song Wang , Zhen Tan , Ruocheng Guo , Jundong Li

Preference alignment is an essential step in adapting large language models (LLMs) to human values, but existing approaches typically depend on costly human annotations or large-scale API-based models. We explore whether a weak LLM can…

Computation and Language · Computer Science 2026-03-06 Amirabbas Afzali , Myeongho Jeon , Maria Brbic

User preferences are increasingly used to personalize Large Language Model (LLM) responses, yet how to reliably leverage preference signals for answer generation remains under-explored. In practice, preferences can be noisy, incomplete, or…

Computation and Language · Computer Science 2026-04-09 Tianyu Zhao , Siqi Li , Yasser Shoukry , Salma Elmalaki

Preference-based feedback is important for many applications in machine learning where evaluation of a reward function is not feasible. Notable recent examples arise in preference alignment for large language models, including in…

Aligning large language models (LLMs) with human preferences has been recognized as the key to improving LLMs' interaction quality. However, in this pluralistic world, human preferences can be diversified due to annotators' different…

Artificial Intelligence · Computer Science 2024-10-08 Dun Zeng , Yong Dai , Pengyu Cheng , Longyue Wang , Tianhao Hu , Wanshun Chen , Nan Du , Zenglin Xu

Human feedback has become the de facto standard for evaluating the performance of Large Language Models, and is increasingly being used as a training objective. However, it is not clear which properties of a generated output this single…

Computation and Language · Computer Science 2024-01-17 Tom Hosking , Phil Blunsom , Max Bartolo

Recommendation systems leverage user interaction data to suggest relevant items while filtering out irrelevant (negative) ones. The rise of large language models (LLMs) has garnered increasing attention for their potential in recommendation…

Information Retrieval · Computer Science 2025-08-14 Chenlu Ding , Daoxuan Liu , Jiancan Wu , Xingyu Hu , Junkang Wu , Haitao Wang , Yongkang Wang , Xingxing Wang , Xiang Wang

Many real-world optimization problems are guided by complex, subjective preferences that are difficult to express as explicit closed-form objectives. In response, we introduce Language-in-the-Loop Optimization (LILO), a Bayesian…

Machine Learning · Computer Science 2026-05-12 Katarzyna Kobalczyk , Zhiyuan Jerry Lin , Benjamin Letham , Zhuokai Zhao , Maximilian Balandat , Eytan Bakshy

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

Computation and Language · Computer Science 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

This work studies the problem of large language model (LLM) unlearning, aiming to remove unwanted data influences (e.g., copyrighted or harmful content) while preserving model utility. Despite the increasing demand for unlearning, a…

Computation and Language · Computer Science 2025-10-21 Chongyu Fan , Jiancheng Liu , Licong Lin , Jinghan Jia , Ruiqi Zhang , Song Mei , Sijia Liu

Recently, preference optimization methods such as DPO have significantly enhanced large language models (LLMs) in wide tasks including dialogue and question-answering. However, current methods fail to account for the varying difficulty…

Computation and Language · Computer Science 2024-12-31 Jingyuan Ma , Rui Li , Zheng Li , Lei Sha , Zhifang Sui

Implicit feedback, often used to build recommender systems, unavoidably confronts noise due to factors such as misclicks and position bias. Previous studies have attempted to alleviate this by identifying noisy samples based on their…

Information Retrieval · Computer Science 2024-09-17 Tianrui Song , Wenshuo Chao , Hao Liu

Despite the parallel challenges that audio and text domains face in evaluating generative model outputs, preference learning remains remarkably underexplored in audio applications. Through a PRISMA-guided systematic review of approximately…

Sound · Computer Science 2025-11-19 Aaron Broukhim , Yiran Shen , Prithviraj Ammanabrolu , Nadir Weibel