English
Related papers

Related papers: PersonalLLM: Tailoring LLMs to Individual Preferen…

200 papers

Personalization plays a critical role in numerous language tasks and applications, since users with the same requirements may prefer diverse outputs based on their individual interests. This has led to the development of various…

Computation and Language · Computer Science 2024-09-19 Jiongnan Liu , Yutao Zhu , Shuting Wang , Xiaochi Wei , Erxue Min , Yu Lu , Shuaiqiang Wang , Dawei Yin , Zhicheng Dou

Large language models (LLMs) have traditionally been aligned through one-size-fits-all approaches that assume uniform human preferences, fundamentally overlooking the diversity in user values and needs. This paper introduces a comprehensive…

Computation and Language · Computer Science 2025-05-23 Jia-Nan Li , Jian Guan , Songhao Wu , Wei Wu , Rui Yan

Personalizing large language models (LLMs) is essential for delivering tailored interactions that improve user experience. Many existing personalization methods require fine-tuning LLMs for each user, rendering them prohibitively expensive…

Machine Learning · Computer Science 2025-03-06 Yijing Zhang , Dyah Adila , Changho Shin , Frederic Sala

Personalized preference alignment for large language models (LLMs), the process of tailoring LLMs to individual users' preferences, is an emerging research direction spanning the area of NLP and personalization. In this survey, we present…

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

Motivated by the remarkable progress of large language models (LLMs) in objective tasks like mathematics and coding, there is growing interest in their potential to simulate human behavior--a capability with profound implications for…

Computation and Language · Computer Science 2026-01-23 Yuxuan Lei , Tianfu Wang , Jianxun Lian , Zhengyu Hu , Defu Lian , Xing Xie

Large Language Models (LLMs) have emerged as personalized assistants for users across a wide range of tasks -- from offering writing support to delivering tailored recommendations or consultations. Over time, the interaction history between…

Computation and Language · Computer Science 2025-10-28 Bowen Jiang , Zhuoqun Hao , Young-Min Cho , Bryan Li , Yuan Yuan , Sihao Chen , Lyle Ungar , Camillo J. Taylor , Dan Roth

The holy grail of LLM personalization is a single LLM for each user, perfectly aligned with that user's preferences. However, maintaining a separate LLM per user is impractical due to constraints on compute, memory, and system complexity.…

Computation and Language · Computer Science 2026-04-13 Cheol Woo Kim , Jai Moondra , Roozbeh Nahavandi , Andrew Perrault , Milind Tambe , Swati Gupta

The recent surge of versatile large language models (LLMs) largely depends on aligning increasingly capable foundation models with human intentions by preference learning, enhancing LLMs with excellent applicability and effectiveness in a…

Computation and Language · Computer Science 2024-06-19 Ruili Jiang , Kehai Chen , Xuefeng Bai , Zhixuan He , Juntao Li , Muyun Yang , Tiejun Zhao , Liqiang Nie , Min Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

Computation and Language · Computer Science 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

Personalized Large Language Models (LLMs) have been shown to be an effective way to create more engaging and enjoyable user-AI interactions. While previous studies have explored using prompts to elicit specific personality traits in LLMs,…

Computation and Language · Computer Science 2025-11-26 Shi-Wei Dai , Yan-Wei Shie , Tsung-Huan Yang , Lun-Wei Ku , Yung-Hui Li

Large Language Models (LLMs) are increasingly serving as personal assistants, where users share complex and diverse preferences over extended interactions. However, assessing how well LLMs can follow these preferences in realistic,…

Artificial Intelligence · Computer Science 2026-03-05 Qianyun Guo , Yibo Li , Yue Liu , Bryan Hooi

As large language models (LLMs) demonstrate increasingly advanced capabilities, aligning their behaviors with human values and preferences becomes crucial for their wide adoption. While previous research focuses on general alignment to…

Computation and Language · Computer Science 2024-12-17 Shujin Wu , May Fung , Cheng Qian , Jeonghwan Kim , Dilek Hakkani-Tur , Heng Ji

Large language models (LLMs) are used to generate content for a wide range of tasks, and are set to reach a growing audience in coming years due to integration in product interfaces like ChatGPT or search engines like Bing. This intensifies…

Computation and Language · Computer Science 2023-03-10 Hannah Rose Kirk , Bertie Vidgen , Paul Röttger , Scott A. Hale

Tool learning has emerged as a promising direction by extending Large Language Models' (LLMs) capabilities with external tools. Existing tool learning studies primarily focus on the general-purpose tool-use capability, which addresses…

Computation and Language · Computer Science 2025-02-27 Qiancheng Xu , Yongqi Li , Heming Xia , Fan Liu , Min Yang , Wenjie Li

Alignment of Large Language Models (LLMs) aims to align outputs with human preferences, and personalized alignment further adapts models to individual users. This relies on personalized reward models that capture user-specific preferences…

Computation and Language · Computer Science 2026-04-21 Hongru Cai , Yongqi Li , Tiezheng Yu , Fengbin Zhu , Wenjie Wang , Fuli Feng , Wenjie Li

With the rise in capabilities of large language models (LLMs) and their deployment in real-world tasks, evaluating LLM alignment with human preferences has become an important challenge. Current benchmarks average preferences across all…

Artificial Intelligence · Computer Science 2026-04-22 Cristina Garbacea , Heran Wang , Chenhao Tan

Personalized prompting offers large opportunities for deploying large language models (LLMs) to diverse users, yet existing prompt optimization methods primarily focus on task-level optimization while largely overlooking user-specific…

Machine Learning · Computer Science 2026-02-16 Yuchen Ma , Yue Huang , Wenjie Wang , Xiaonan Luo , Xiangliang Zhang , Stefan Feuerriegel

With the rapid improvement in the general capabilities of LLMs, LLM personalization, i.e., how to build LLM systems that can generate personalized responses or services that are tailored to distinct user personas, has become an increasingly…

Computation and Language · Computer Science 2025-06-17 Meiling Tao , Chenghao Zhu , Dongyi Ding , Tiannan Wang , Yuchen Eleanor Jiang , Wangchunshu Zhou

As a relative quality comparison of model responses, human and Large Language Model (LLM) preferences serve as common alignment goals in model fine-tuning and criteria in evaluation. Yet, these preferences merely reflect broad tendencies,…

Computation and Language · Computer Science 2024-02-20 Junlong Li , Fan Zhou , Shichao Sun , Yikai Zhang , Hai Zhao , Pengfei Liu
‹ Prev 1 2 3 10 Next ›