English
Related papers

Related papers: ALIGN: Prompt-based Attribute Alignment for Reliab…

200 papers

Alignment with human preference prevents large language models (LLMs) from generating misleading or toxic content while requiring high-cost human feedback. Assuming resources of human annotation are limited, there are two different ways of…

Computation and Language · Computer Science 2024-04-02 Feifan Song , Bowen Yu , Hao Lang , Haiyang Yu , Fei Huang , Houfeng Wang , Yongbin Li

Human preference data is essential for aligning large language models (LLMs) with human values, but collecting such data is often costly and inefficient-motivating the need for efficient data selection methods that reduce annotation costs…

Computation and Language · Computer Science 2026-04-21 Seohyeong Lee , Eunwon Kim , Hwaran Lee , Buru Chang

Using Large Language Models (LLMs) for relevance assessments offers promising opportunities to improve Information Retrieval (IR), Natural Language Processing (NLP), and related fields. Indeed, LLMs hold the promise of allowing IR…

Large language models (LLMs) can perform recommendation tasks by taking prompts written in natural language as input. Compared to traditional methods such as collaborative filtering, LLM-based recommendation offers advantages in handling…

Information Retrieval · Computer Science 2025-07-21 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

Current benchmarks for Large Language Models (LLMs) primarily focus on performance metrics, often failing to capture the nuanced behavioral characteristics that differentiate them. This paper introduces a novel ``Behavioral Fingerprinting''…

Computation and Language · Computer Science 2025-09-08 Zehua Pei , Hui-Ling Zhen , Ying Zhang , Zhiyuan Yang , Xing Li , Xianzhi Yu , Mingxuan Yuan , Bei Yu

Large language models (LLMs) have advanced conversational AI assistants. However, systematically evaluating how well these assistants apply personalization--adapting to individual user preferences while completing tasks--remains…

Computation and Language · Computer Science 2025-06-12 Zheng Zhao , Clara Vania , Subhradeep Kayal , Naila Khan , Shay B. Cohen , Emine Yilmaz

In this work, we present a modular and interpretable framework that uses Large Language Models (LLMs) to automate candidate assessment in recruitment. The system integrates diverse sources, including job descriptions, CVs, interview…

Information Retrieval · Computer Science 2026-03-31 Kamer Ali Yuksel , Abdul Basit Anees , Ashraf Elneima , Sanjika Hewavitharana , Mohamed Al-Badrashiny , Hassan Sawaf

Recent advances in large language models have highlighted their potential for personalized recommendation, where accurately capturing user preferences remains a key challenge. Leveraging their strong reasoning and generalization…

The reuse of historical clinical trial data has significant potential to accelerate medical research and drug development. However, interoperability challenges, particularly with missing medical codes, hinders effective data integration…

Machine Learning · Computer Science 2025-03-14 Nabeel Seedat , Caterina Tozzi , Andrea Hita Ardiaca , Mihaela van der Schaar , James Weatherall , Adam Taylor

Large language models (LLMs) alignment aims to ensure that the behavior of LLMs meets human preferences. While collecting data from multiple fine-grained, aspect-specific preferences becomes more and more feasible, existing alignment…

Machine Learning · Computer Science 2026-03-03 Jia Zhang , Yao Liu , Chen-Xi Zhang , Yi Liu , Yi-Xuan Jin , Lan-Zhe Guo , Yu-Feng Li

Although humans inherently have diverse values, current large language model (LLM) alignment methods often assume that aligning LLMs with the general public's preferences is optimal. A major challenge in adopting a more individualized…

Computation and Language · Computer Science 2024-11-06 Seongyun Lee , Sue Hyun Park , Seungone Kim , Minjoon Seo

Recommender systems are widely used in online services, with embedding-based models being particularly popular due to their expressiveness in representing complex signals. However, these models often function as a black box, making them…

Information Retrieval · Computer Science 2024-06-25 Yuxuan Lei , Jianxun Lian , Jing Yao , Xu Huang , Defu Lian , Xing Xie

Recent advancements in open-source multi-modal large language models (MLLMs) have primarily focused on enhancing foundational capabilities, leaving a significant gap in human preference alignment. This paper introduces OmniAlign-V, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xiangyu Zhao , Shengyuan Ding , Zicheng Zhang , Haian Huang , Maosong Cao , Weiyun Wang , Jiaqi Wang , Xinyu Fang , Wenhai Wang , Guangtao Zhai , Haodong Duan , Hua Yang , Kai Chen

Recent AI agents, such as ChatGPT and LLaMA, primarily rely on instruction tuning and reinforcement learning to calibrate the output of large language models (LLMs) with human intentions, ensuring the outputs are harmless and helpful.…

Computation and Language · Computer Science 2025-02-14 Jingxin Xu , Guoshun Nan , Sheng Guan , Sicong Leng , Yilian Liu , Zixiao Wang , Yuyang Ma , Zhili Zhou , Yanzhao Hou , Xiaofeng Tao

Recommender systems are essential for guiding users through the vast and diverse landscape of digital content by delivering personalized and relevant suggestions. However, improving both personalization and interpretability remains a…

Information Retrieval · Computer Science 2025-08-05 Danial Ebrat , Tina Aminian , Sepideh Ahmadian , Luis Rueda

Offline evaluation of search systems depends on test collections. These benchmarks provide the researchers with a corpus of documents, topics and relevance judgements indicating which documents are relevant for each topic. While test…

Information Retrieval · Computer Science 2025-07-23 David Otero , Javier Parapar , Álvaro Barreiro

In difficult decision-making scenarios, it is common to have conflicting opinions among expert human decision-makers as there may not be a single right answer. Such decisions may be guided by different attributes that can be used to…

Computation and Language · Computer Science 2024-06-11 Brian Hu , Bill Ray , Alice Leung , Amy Summerville , David Joy , Christopher Funk , Arslan Basharat

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

Computation and Language · Computer Science 2025-04-08 Menglin Liu , Ge Shi

Large-language Models (LLMs) have been extremely successful at tasks like complex dialogue understanding, reasoning and coding due to their emergent abilities. These emergent abilities have been extended with multi-modality to include…

Information Retrieval · Computer Science 2025-05-19 Li Yang , Anushya Subbiah , Hardik Patel , Judith Yue Li , Yanwei Song , Reza Mirghaderi , Vikram Aggarwal , Qifan Wang

Large Language Models (LLMs) have fundamentally reshaped Argument Mining (AM), shifting it from a pipeline of supervised, task-specific classifiers to a spectrum of prompt-driven, retrieval-augmented, and reasoning-oriented paradigms. Yet…

Computation and Language · Computer Science 2025-11-26 Hao Li , Viktor Schlegel , Yizheng Sun , Riza Batista-Navarro , Goran Nenadic