English
Related papers

Related papers: Knowledgeable Preference Alignment for LLMs in Dom…

200 papers

As large language models (LLMs) become integral to intelligent user interfaces (IUIs), their role as decision-making agents raises critical concerns about alignment. Although extensive research has addressed issues such as factuality, bias,…

Artificial Intelligence · Computer Science 2025-04-23 Anna Karnysheva , Christian Drescher , Dietrich Klakow

The recent surge of versatile large language models (LLMs) largely depends on aligning increasingly capable foundation models with human intentions by preference learning, enhancing LLMs with excellent applicability and effectiveness in a…

Computation and Language · Computer Science 2024-06-19 Ruili Jiang , Kehai Chen , Xuefeng Bai , Zhixuan He , Juntao Li , Muyun Yang , Tiejun Zhao , Liqiang Nie , Min Zhang

Large language models (LLMs) are increasingly being used as decision aids. However, users have diverse values and preferences that can affect their decision-making, which requires novel methods for LLM alignment and personalization.…

Computation and Language · Computer Science 2025-07-15 Bharadwaj Ravichandran , David Joy , Paul Elliott , Brian Hu , Jadie Adams , Christopher Funk , Emily Veenhuis , Anthony Hoogs , Arslan Basharat

As a relative quality comparison of model responses, human and Large Language Model (LLM) preferences serve as common alignment goals in model fine-tuning and criteria in evaluation. Yet, these preferences merely reflect broad tendencies,…

Computation and Language · Computer Science 2024-02-20 Junlong Li , Fan Zhou , Shichao Sun , Yikai Zhang , Hai Zhao , Pengfei Liu

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

Computation and Language · Computer Science 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

Preference mechanisms, such as human preference, LLM-as-a-Judge (LaaJ), and reward models, are central to aligning and evaluating large language models (LLMs). Yet, the underlying concepts that drive these preferences remain poorly…

Computation and Language · Computer Science 2025-05-30 Nitay Calderon , Liat Ein-Dor , Roi Reichart

Large language models (LLMs) must often respond to highly ambiguous user requests. In such cases, the LLM's best response may be to ask a clarifying question to elicit more information. Existing LLMs often respond by presupposing a single…

Computation and Language · Computer Science 2025-03-19 Michael J. Q. Zhang , W. Bradley Knox , Eunsol Choi

Recent advances in reasoning with large language models (LLMs) have demonstrated strong performance on complex mathematical tasks, including combinatorial optimization. Techniques such as Chain-of-Thought and In-Context Learning have…

Artificial Intelligence · Computer Science 2025-09-17 Marylou Fauchard , Florian Carichon , Margarida Carvalho , Golnoosh Farnadi

Large language models (LLMs) have demonstrated remarkable capabilities in various complex tasks, yet they still suffer from hallucinations. By incorporating and exploring external knowledge, such as knowledge graphs(KGs), LLM's ability to…

Artificial Intelligence · Computer Science 2025-05-27 Qi Zhao , Hongyu Yang , Qi Song , Xinwei Yao , Xiangyang Li

Large Language Models (LLMs) excel at understanding natural language but struggle with optimisation tasks involving multiple constraints and user-defined preferences, which commonly arise in domains such as robotics. We propose a hybrid…

Artificial Intelligence · Computer Science 2026-05-29 Pedro Orvalho , Marta Kwiatkowska , Guillem Alenyà , Felip Manyà

Recent advancements in open-source multi-modal large language models (MLLMs) have primarily focused on enhancing foundational capabilities, leaving a significant gap in human preference alignment. This paper introduces OmniAlign-V, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xiangyu Zhao , Shengyuan Ding , Zicheng Zhang , Haian Huang , Maosong Cao , Weiyun Wang , Jiaqi Wang , Xinyu Fang , Wenhai Wang , Guangtao Zhai , Haodong Duan , Hua Yang , Kai Chen

Log analysis represents a critical sub-domain within AI applications that facilitates automatic approaches to fault and error management of large-scaled software systems, saving labors of traditional manual methods. While existing solutions…

Computation and Language · Computer Science 2025-08-27 Yuhe Ji , Yilun Liu , Feiyu Yao , Minggui He , Shimin Tao , Xiaofeng Zhao , Su Chang , Xinhua Yang , Weibin Meng , Yuming Xie , Boxing Chen , Shenglin Zhang , Yongqian Sun

LLMs increasingly serve as tools for knowledge acquisition, yet users cannot effectively specify how they want information presented. When users request that LLMs "cite reputable sources," "express appropriate uncertainty," or "include…

Human-Computer Interaction · Computer Science 2025-04-03 Nicholas Clark , Hua Shen , Bill Howe , Tanushree Mitra

Aligning large language models (LLMs) to human preferences is challenging in domains where preference data is unavailable. We address the problem of learning reward models for such target domains by leveraging feedback collected from…

Machine Learning · Computer Science 2025-01-03 David Wu , Sanjiban Choudhury

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

Preference alignment in Large Language Models (LLMs) has significantly improved their ability to adhere to human instructions and intentions. However, existing direct alignment algorithms primarily focus on relative preferences and often…

Machine Learning · Computer Science 2025-05-13 Shenao Zhang , Zhihan Liu , Boyi Liu , Yufeng Zhang , Yingxiang Yang , Yongfei Liu , Liyu Chen , Tao Sun , Zhaoran Wang

Large Language Models (LLMs) are expected to be predictable and trustworthy to support reliable decision-making systems. Yet current LLMs often show inconsistencies in their judgments. In this work, we examine logical preference consistency…

Computation and Language · Computer Science 2025-02-11 Yinhong Liu , Zhijiang Guo , Tianya Liang , Ehsan Shareghi , Ivan Vulić , Nigel Collier

The explainability of recommendation systems is crucial for enhancing user trust and satisfaction. Leveraging large language models (LLMs) offers new opportunities for comprehensive recommendation logic generation. However, in existing…

Information Retrieval · Computer Science 2024-07-04 Hongke Zhao , Songming Zheng , Likang Wu , Bowen Yu , Jing Wang

Aligning large language models (LLMs) typically aim to reflect general human values and behaviors, but they often fail to capture the unique characteristics and preferences of individual users. To address this gap, we introduce the concept…

Computation and Language · Computer Science 2025-03-11 Minjun Zhu , Yixuan Weng , Linyi Yang , Yue Zhang

Aligning large language models (LLMs) with human preferences becomes a key component to obtaining state-of-the-art performance, but it yields a huge cost to construct a large human-annotated preference dataset. To tackle this problem, we…

Machine Learning · Computer Science 2025-03-05 Dongyoung Kim , Kimin Lee , Jinwoo Shin , Jaehyung Kim