English
Related papers

Related papers: Preference Estimation via Opponent Modeling in Mul…

200 papers

Large Visual Language Models (LVLMs) increasingly rely on preference alignment to ensure reliability, which steers the model behavior via preference fine-tuning on preference data structured as ``image - winner text - loser text'' triplets.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Kejia Chen , Jiawen Zhang , Jiacong Hu , Jiazhen Yang , Jian Lou , Zunlei Feng , Mingli Song

Large language models (LLMs) are increasingly deployed in decision-support systems for high-stakes domains such as hiring and university admissions, where choices often involve selecting among competing alternatives. While prior work has…

Artificial Intelligence · Computer Science 2026-04-15 Haonan Yin , Shai Vardi , Vidyanand Choudhary

Accommodating human preferences is essential for creating AI agents that deliver personalized and effective interactions. Recent work has shown the potential for LLMs to infer preferences from user interactions, but they often produce broad…

Artificial Intelligence · Computer Science 2024-10-10 Stephane Aroca-Ouellette , Natalie Mackraz , Barry-John Theobald , Katherine Metcalf

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

Computation and Language · Computer Science 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

Preference optimization is widely used to align Large Language Models (LLMs) with preference feedback. However, most existing methods train on a single positive-negative pair per prompt, discarding additional supervision available in…

Computation and Language · Computer Science 2026-04-20 Jixuan Leng , Si Si , Hsiang-Fu Yu , Vinod Raman , Inderjit S. Dhillon

Reward modeling, crucial for aligning large language models (LLMs) with human preferences, is often bottlenecked by the high cost of preference data. Existing textual data synthesis methods are computationally expensive. We propose a novel…

Computation and Language · Computer Science 2025-10-15 Leitian Tao , Xuefeng Du , Sharon Li

Large language models (LLMs) have recently shown great advances in a variety of tasks, including natural language understanding and generation. However, their use in high-stakes decision-making scenarios is still limited due to the…

Computation and Language · Computer Science 2023-11-14 Jiefeng Chen , Jinsung Yoon , Sayna Ebrahimi , Sercan O Arik , Tomas Pfister , Somesh Jha

Can large language models (LLMs) learn a decision maker's preferences from observed choices and generate preference-consistent recommendations in new situations? We propose a portable Simulate-Recommend-Evaluate framework that tests…

General Economics · Economics 2026-04-08 Jeongbin Kim , Matthew Kovach , Kyu-Min Lee , Euncheol Shin , Hector Tzavellas

Deep Reinforcement Learning is widely used for aligning Large Language Models (LLM) with human preference. However, the conventional reward modelling is predominantly dependent on human annotations provided by a select cohort of…

Artificial Intelligence · Computer Science 2024-05-31 Dexun Li , Cong Zhang , Kuicai Dong , Derrick Goh Xin Deik , Ruiming Tang , Yong Liu

A key requirement in developing Generative Language Models (GLMs) is to have their values aligned with human values. Preference-based alignment is a widely used paradigm for this purpose, in which preferences over generation pairs are first…

Computation and Language · Computer Science 2024-04-16 Yang Gao , Dana Alon , Donald Metzler

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

Computation and Language · Computer Science 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

Large Language Models (LLMs) have demonstrated promising capabilities as automatic evaluators in assessing the quality of generated natural language. However, LLMs still exhibit biases in evaluation and often struggle to generate coherent…

Computation and Language · Computer Science 2025-01-20 Yinhong Liu , Han Zhou , Zhijiang Guo , Ehsan Shareghi , Ivan Vulić , Anna Korhonen , Nigel Collier

While learning to align Large Language Models (LLMs) with human preferences has shown remarkable success, aligning these models to meet the diverse user preferences presents further challenges in preserving previous knowledge. This paper…

Artificial Intelligence · Computer Science 2024-10-01 Gihun Lee , Minchan Jeong , Yujin Kim , Hojung Jung , Jaehoon Oh , Sangmook Kim , Se-Young Yun

Large language models (LLMs) often generate natural language rationales -- free-form explanations that help improve performance on complex reasoning tasks and enhance interpretability for human users. However, evaluating these rationales…

Artificial Intelligence · Computer Science 2025-09-16 Ziang Li , Manasi Ganti , Zixian Ma , Helena Vasconcelos , Qijia He , Ranjay Krishna

While textless Spoken Language Models (SLMs) have shown potential in end-to-end speech-to-speech modeling, they still lag behind text-based Large Language Models (LLMs) in terms of semantic coherence and relevance. This work introduces the…

Computation and Language · Computer Science 2025-05-28 Guan-Ting Lin , Prashanth Gurunath Shivakumar , Aditya Gourav , Yile Gu , Ankur Gandhe , Hung-yi Lee , Ivan Bulyko

Finding preferences expressed in natural language is an important but challenging task. State-of-the-art(SotA) methods leverage transformer-based models such as BERT, RoBERTa, etc. and graph neural architectures such as graph attention…

Computation and Language · Computer Science 2023-10-13 Inwon Kang , Sikai Ruan , Tyler Ho , Jui-Chien Lin , Farhad Mohsin , Oshani Seneviratne , Lirong Xia

Learning from preference labels plays a crucial role in fine-tuning large language models. There are several distinct approaches for preference fine-tuning, including supervised learning, on-policy reinforcement learning (RL), and…

The rapid advancement of large language models (LLMs) has facilitated their transformation into conversational chatbots that can grasp contextual nuances and generate pertinent sentences, closely mirroring human values through advanced…

Computation and Language · Computer Science 2024-07-19 Janghwan Lee , Seongmin Park , Sukjin Hong , Minsoo Kim , Du-Seong Chang , Jungwook Choi

Aligning with human preference datasets has been critical to the success of large language models (LLMs). Reinforcement learning from human feedback (RLHF) employs a costly reward model to provide feedback for on-policy sampling responses.…

Machine Learning · Computer Science 2024-05-24 Yuanzhao Zhai , Zhuo Zhang , Kele Xu , Hanyang Peng , Yue Yu , Dawei Feng , Cheng Yang , Bo Ding , Huaimin Wang