English
Related papers

Related papers: PersonalLLM: Tailoring LLMs to Individual Preferen…

200 papers

A long-standing challenge in developing accurate recommendation models is simulating user behavior, mainly due to the complex and stochastic nature of user interactions. Towards this, one promising line of work has been the use of Large…

Information Retrieval · Computer Science 2025-09-15 Himanshu Thakur , Eshani Agrawal , Smruthi Mukund

As large language models (LLMs) become increasingly integrated into daily applications, it is essential to ensure they operate fairly across diverse user demographics. In this work, we show that LLMs suffer from personalization bias, where…

Computation and Language · Computer Science 2025-02-12 Anvesh Rao Vijjini , Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

Computation and Language · Computer Science 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

User preferences are increasingly used to personalize Large Language Model (LLM) responses, yet how to reliably leverage preference signals for answer generation remains under-explored. In practice, preferences can be noisy, incomplete, or…

Computation and Language · Computer Science 2026-04-09 Tianyu Zhao , Siqi Li , Yasser Shoukry , Salma Elmalaki

Current large language model (LLM) development treats task-solving and preference-alignment as separate challenges, optimizing first for objective correctness, then for alignment to aggregated human preferences. This paradigm fails in…

Computation and Language · Computer Science 2026-03-06 Shuyue Stella Li , Avinandan Bose , Faeze Brahman , Simon Shaolei Du , Pang Wei Koh , Maryam Fazel , Yulia Tsvetkov

While Reinforcement Learning from Human Feedback (RLHF) is widely used to align Large Language Models (LLMs) with human preferences, it typically assumes homogeneous preferences across users, overlooking diverse human values and minority…

Computation and Language · Computer Science 2025-10-28 Yijiang River Dong , Tiancheng Hu , Yinhong Liu , Ahmet Üstün , Nigel Collier

Recent advances in Large Language Models (LLMs) highlight the need to align their behaviors with human values. A critical, yet understudied, issue is the potential divergence between an LLM's stated preferences (its reported alignment with…

Artificial Intelligence · Computer Science 2025-06-03 Zhuojun Gu , Quan Wang , Shuchu Han

Large language models (LLMs) are increasingly used to simulate human behavior, but their ability to simulate $individual$ privacy decisions is not well understood. In this paper, we address the problem of evaluating whether a core set of…

Cryptography and Security · Computer Science 2026-05-13 James Flemings , Murali Annavaram

Large Language Models (LLMs) are increasingly used as chatbots, yet their ability to personalize responses to user preferences remains limited. We introduce PrefEval, a benchmark for evaluating LLMs' ability to infer, memorize and adhere to…

Machine Learning · Computer Science 2025-02-14 Siyan Zhao , Mingyi Hong , Yang Liu , Devamanyu Hazarika , Kaixiang Lin

Aligning large language models (LLMs) typically aim to reflect general human values and behaviors, but they often fail to capture the unique characteristics and preferences of individual users. To address this gap, we introduce the concept…

Computation and Language · Computer Science 2025-03-11 Minjun Zhu , Yixuan Weng , Linyi Yang , Yue Zhang

The rapid development of large language models (LLMs) has transformed many industries, including healthcare. However, previous medical LLMs have largely focused on leveraging general medical knowledge to provide responses, without…

Computation and Language · Computer Science 2024-12-23 Ruize Shi , Hong Huang , Wei Zhou , Kehan Yin , Kai Zhao , Yun Zhao

Reinforcement learning (RL) is increasingly being used in the healthcare domain, particularly for the development of personalized health adaptive interventions. Inspired by the success of Large Language Models (LLMs), we are interested in…

Machine Learning · Computer Science 2025-01-14 Karine Karine , Benjamin M. Marlin

Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of applications. Despite the importance and recent progress, most existing works on personalized LLMs have focused either entirely…

Current benchmarks for evaluating Large Language Models (LLMs) often do not exhibit enough writing style diversity, with many adhering primarily to standardized conventions. Such benchmarks do not fully capture the rich variety of…

Computation and Language · Computer Science 2025-09-29 Kimberly Le Truong , Riccardo Fogliato , Hoda Heidari , Zhiwei Steven Wu

Large language models (LLMs) are increasingly being used as decision aids. However, users have diverse values and preferences that can affect their decision-making, which requires novel methods for LLM alignment and personalization.…

Computation and Language · Computer Science 2025-07-15 Bharadwaj Ravichandran , David Joy , Paul Elliott , Brian Hu , Jadie Adams , Christopher Funk , Emily Veenhuis , Anthony Hoogs , Arslan Basharat

In this work, we introduce the task of life-long personalization of large language models. While recent mainstream efforts in the LLM community mainly focus on scaling data and compute for improved capabilities of LLMs, we argue that it is…

Computation and Language · Computer Science 2024-12-18 Tiannan Wang , Meiling Tao , Ruoyu Fang , Huilin Wang , Shuai Wang , Yuchen Eleanor Jiang , Wangchunshu Zhou

Accurately modeling user preferences is vital not only for improving recommendation performance but also for enhancing transparency in recommender systems. Conventional user profiling methods, such as averaging item embeddings, often…

Information Retrieval · Computer Science 2025-05-05 Milad Sabouri , Masoud Mansoury , Kun Lin , Bamshad Mobasher

Reward models (RMs) are essential for aligning large language models (LLMs) with human preferences to improve interaction quality. However, the real world is pluralistic, which leads to diversified human preferences with respect to…

Computation and Language · Computer Science 2023-09-18 Pengyu Cheng , Jiawen Xie , Ke Bai , Yong Dai , Nan Du

Aligning Large Language Models (LLMs) with general human preferences has been proved crucial in improving the interaction quality between LLMs and human. However, human values are inherently diverse among different individuals, making it…

Computation and Language · Computer Science 2024-12-31 Jianfei Zhang , Jun Bai , Bei Li , Yanmeng Wang , Rumei Li , Chenghua Lin , Wenge Rong

Large language models (LLMs) have significantly advanced Natural Language Processing (NLP) tasks in recent years. However, their universal nature poses limitations in scenarios requiring personalized responses, such as recommendation…

Computation and Language · Computer Science 2024-11-08 Stanisław Woźniak , Bartłomiej Koptyra , Arkadiusz Janz , Przemysław Kazienko , Jan Kocoń