English
Related papers

Related papers: Reasoning-Based Personalized Generation for Users …

200 papers

This paper studies retrieval-augmented approaches for personalizing large language models (LLMs), which potentially have a substantial impact on various applications and domains. We propose the first attempt to optimize the retrieval models…

Computation and Language · Computer Science 2024-04-19 Alireza Salemi , Surya Kallumadi , Hamed Zamani

Preference alignment has enabled large language models (LLMs) to better reflect human expectations, but current methods mostly optimize for population-level preferences, overlooking individual users. Personalization is essential, yet early…

Computation and Language · Computer Science 2026-03-06 Chengbing Wang , Yang Zhang , Wenjie Wang , Xiaoyan Zhao , Fuli Feng , Xiangnan He , Tat-Seng Chua

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning, generalization, and simulating human-like behavior across a wide range of tasks. These strengths present new opportunities to enhance traditional…

Information Retrieval · Computer Science 2025-12-01 Nachiket Subbaraman , Jaskinder Sarai , Aniruddh Nath , Lichan Hong , Lukasz Heldt , Li Wei , Zhe Zhao

We propose a novel framework for persona-based language model system, motivated by the need for personalized AI agents that adapt to individual user preferences. In our approach, the agent embodies the user's "persona" (e.g. user profile or…

Machine Learning · Computer Science 2025-12-03 Siqi Liang , Yudi Zhang , Yue Guo

The growing number of Large Language Models (LLMs) with diverse capabilities and response styles provides users with a wider range of choices, which presents challenges in selecting appropriate LLMs, as user preferences vary in terms of…

Machine Learning · Computer Science 2025-11-24 Zhongjie Dai , Tao Feng , Jiaxuan You

In recent years, Recommender Systems(RS) have witnessed a transformative shift with the advent of Large Language Models(LLMs) in the field of Natural Language Processing(NLP). These models such as OpenAI's GPT-3.5/4, Llama from Meta, have…

Information Retrieval · Computer Science 2023-11-22 Junyi Chen

Sequential Recommendation System~(SRS) has become pivotal in modern society, which predicts subsequent actions based on the user's historical behavior. However, traditional collaborative filtering-based sequential recommendation models…

Information Retrieval · Computer Science 2025-11-26 Tianjie Dai , Xu Chen , Yunmeng Shu , Jinsong Lan , Xiaoyong Zhu , Jiangchao Yao , Bo Zheng

Leveraging users' long engagement histories is essential for personalized content recommendations. The success of pretrained language models (PLMs) in NLP has led to their use in encoding user histories and candidate items, framing content…

Information Retrieval · Computer Science 2024-05-24 Chiyu Zhang , Yifei Sun , Jun Chen , Jie Lei , Muhammad Abdul-Mageed , Sinong Wang , Rong Jin , Sem Park , Ning Yao , Bo Long

As LLMs become capable of complex tasks, there is growing potential for personalized interactions tailored to the subtle and idiosyncratic preferences of the user. We present a public benchmark, PersonalLLM, focusing on adapting LLMs to…

Machine Learning · Computer Science 2025-02-25 Thomas P. Zollo , Andrew Wei Tung Siah , Naimeng Ye , Ang Li , Hongseok Namkoong

Recently, the personalization of Large Language Models (LLMs) to generate content that aligns with individual user preferences has garnered widespread attention. Personalized Retrieval-Augmented Generation (RAG), which retrieves relevant…

Information Retrieval · Computer Science 2025-04-09 Teng Shi , Jun Xu , Xiao Zhang , Xiaoxue Zang , Kai Zheng , Yang Song , Han Li

Large language model (LLM)-powered assistants have recently integrated memory mechanisms that record user preferences, leading to more personalized and user-aligned responses. However, irrelevant personalized memories are often introduced…

Computation and Language · Computer Science 2026-01-26 Xueyang Feng , Weinan Gan , Xu Chen , Quanyu Dai , Yong Liu

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

Computation and Language · Computer Science 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

With the rapid advancement of Natural Language Processing in recent years, numerous studies have shown that generic summaries generated by Large Language Models (LLMs) can sometimes surpass those annotated by experts, such as journalists,…

Computation and Language · Computer Science 2024-10-08 Lemei Zhang , Peng Liu , Marcus Tiedemann Oekland Henriksboe , Even W. Lauvrak , Jon Atle Gulla , Heri Ramampiaro

As Large Language Models (LLMs) continue to exhibit increasingly human-like capabilities, aligning them with human values has become critically important. Contemporary advanced techniques, such as prompt learning and reinforcement learning,…

Computation and Language · Computer Science 2025-06-06 Bangde Du , Ziyi Ye , Zhijing Wu , Jankowska Monika , Shuqi Zhu , Qingyao Ai , Yujia Zhou , Yiqun Liu

Large Language Models (LLMs) are increasingly serving as personal assistants, where users share complex and diverse preferences over extended interactions. However, assessing how well LLMs can follow these preferences in realistic,…

Artificial Intelligence · Computer Science 2026-03-05 Qianyun Guo , Yibo Li , Yue Liu , Bryan Hooi

Personalized alignment is essential for enabling large language models (LLMs) to engage effectively in user-centric dialogue. While recent prompt-based and offline optimization methods offer preliminary solutions, they fall short in…

Computation and Language · Computer Science 2025-12-12 Weixiang Zhao , Xingyu Sui , Yulin Hu , Jiahe Guo , Haixiao Liu , Biye Li , Yanyan Zhao , Bing Qin , Ting Liu

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Computation and Language · Computer Science 2025-09-30 Qinggang Zhang , Shengyuan Chen , Yuanchen Bei , Zheng Yuan , Huachi Zhou , Zijin Hong , Hao Chen , Yilin Xiao , Chuang Zhou , Junnan Dong , Yi Chang , Xiao Huang

Large Language Models (LLMs) have quickly become an invaluable assistant for a variety of tasks. However, their effectiveness is constrained by their ability to tailor responses to human preferences and behaviors via personalization. Prior…

Computation and Language · Computer Science 2024-11-21 Lucie Charlotte Magister , Katherine Metcalf , Yizhe Zhang , Maartje ter Hoeve

In the field of emotion recognition, the development of high-performance models remains a challenge due to the scarcity of high-quality, diverse emotional datasets. Emotional expressions are inherently subjective, shaped by individual…

Computation and Language · Computer Science 2025-09-16 Keito Inoshita , Rushia Harada

Large language models (LLMs) have attracted considerable attention as they are capable of showcasing impressive capabilities generating comparable high-quality responses to human inputs. LLMs, can not only compose textual scripts such as…

Computational Engineering, Finance, and Science · Computer Science 2024-05-31 Denish Omondi Otieno , Faranak Abri , Sima Siami-Namini , Akbar Siami Namin