English
Related papers

Related papers: PersonaDual: Balancing Personalization and Objecti…

200 papers

The analysis and mining of user heterogeneous behavior are of paramount importance in recommendation systems. However, the conventional approach of incorporating various types of heterogeneous behavior into recommendation models leads to…

Information Retrieval · Computer Science 2023-08-21 Bin Yin , Junjie Xie , Yu Qin , Zixiang Ding , Zhichao Feng , Xiang Li , Wei Lin

Generative large language models(LLMs) are proficient in solving general problems but often struggle to handle domain-specific tasks. This is because most of domain-specific tasks, such as personalized recommendation, rely on task-related…

Information Retrieval · Computer Science 2023-11-08 Wenxuan Zhang , Hongzhi Liu , Yingpeng Du , Chen Zhu , Yang Song , Hengshu Zhu , Zhonghai Wu

Reinforcement Learning from Human Feedback (RLHF) effectively aligns Large Language Models (LLMs) with aggregate human preferences but often fails to address the diverse and conflicting needs of individual users. To overcome this issue, we…

Machine Learning · Computer Science 2026-05-21 Yinlam Chow , Guy Tennenholtz , Ted Yun , James Harrison , Arthur Gretton , Andre Barreto , Bo Dai

Personalized AI agents are becoming central to modern information retrieval, yet most evaluation methodologies remain static, relying on fixed benchmarks and one-off metrics that fail to reflect how users' needs evolve over time. These…

Information Retrieval · Computer Science 2025-10-07 Kirandeep Kaur , Preetam Prabhu Srikar Dammu , Hideo Joho , Chirag Shah

For socially sensitive tasks like hate speech detection, the quality of explanations from Large Language Models (LLMs) is crucial for factors like user trust and model alignment. While Persona prompting (PP) is increasingly used as a way to…

Computation and Language · Computer Science 2026-01-29 Jing Yang , Moritz Hechtbauer , Elisabeth Khalilov , Evelyn Luise Brinkmann , Vera Schmitt , Nils Feldhus

Modern large language models (LLMs) are optimized for human-aligned responses using Reinforcement Learning from Human Feedback (RLHF). However, existing RLHF approaches assume a universal preference model and fail to account for individual…

Machine Learning · Computer Science 2025-03-11 Idan Shenfeld , Felix Faltings , Pulkit Agrawal , Aldo Pacchiano

A common technique for aligning large language models (LLMs) relies on acquiring human preferences by comparing multiple generations conditioned on a fixed context. This method, however, relies solely on pairwise comparisons, where the…

Computation and Language · Computer Science 2025-01-09 Hritik Bansal , Ashima Suvarna , Gantavya Bhatt , Nanyun Peng , Kai-Wei Chang , Aditya Grover

Personality detection aims to measure an individual's corresponding personality traits through their social media posts. The advancements in Large Language Models (LLMs) offer novel perspectives for personality detection tasks. Existing…

Computation and Language · Computer Science 2026-01-27 Yuan Cao , Feixiang Liu , Xinyue Wang , Yihan Zhu , Hui Xu , Zheng Wang , Qiang Qiu

Post-training paradigms for Large Language Models (LLMs), primarily Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), face a fundamental dilemma: SFT provides stability (low variance) but suffers from high fitting bias, while RL…

Machine Learning · Computer Science 2026-04-13 Taojie Zhu , Dongyang Xu , Ding Zou , Sen Zhao , Qiaobo Hao , Zhiguo Yang , Yonghong He

Explainable AI is increasingly employing argumentation methods to facilitate interactive explanations between AI agents and human users. While existing approaches typically rely on predetermined human user models, there remains a critical…

Artificial Intelligence · Computer Science 2025-02-25 Yinxu Tang , Stylianos Loukas Vasileiou , William Yeoh

Personalised education is one of the domains that can greatly benefit from the most recent advances in Artificial Intelligence (AI) and Large Language Models (LLM). However, it is also one of the most challenging applications due to the…

Computers and Society · Computer Science 2025-02-18 Sahan Bulathwela , Daniel Van Niekerk , Jarrod Shipton , Maria Perez-Ortiz , Benjamin Rosman , John Shawe-Taylor

This work investigates the task of unsupervised model personalization, adapted to continually evolving, unlabeled local user images. We consider the practical scenario where a high capacity server interacts with a myriad of resource-limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Matthias De Lange , Xu Jia , Sarah Parisot , Ales Leonardis , Gregory Slabaugh , Tinne Tuytelaars

Personalized retrieval-augmented generation (RAG) aims to produce user-tailored responses by incorporating retrieved user profiles alongside the input query. Existing methods primarily focus on improving retrieval and rely on large language…

Information Retrieval · Computer Science 2025-08-12 Kepu Zhang , Teng Shi , Weijie Yu , Jun Xu

Personalized alignment of large language models seeks to adapt responses to individual user preferences, typically via reinforcement learning. A key challenge is obtaining accurate, user-specific reward signals in open-ended scenarios.…

Computation and Language · Computer Science 2026-02-13 Pinyi Zhang , Ting-En Lin , Yuchuan Wu , Jingyang Chen , Zongqi Wang , Hua Yang , Ze Xu , Fei Huang , Kai Zhang , Yongbin Li

In recent years, large language models (LLMs) have achieved breakthrough progress in many dialogue generation tasks. However, their lack of emotion and fine-grained role awareness limits the model's ability to provide personalized and…

Computation and Language · Computer Science 2025-03-26 Ke Ji , Yixin Lian , Linxu Li , Jingsheng Gao , Weiyuan Li , Bin Dai

The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computational insights. However, despite the promise of human-AI…

Neurons and Cognition · Quantitative Biology 2025-04-22 Stephen Chong Zhao , Yang Hu , Jason Lee , Andrew Bender , Trisha Mazumdar , Mark Wallace , David A. Tovar

Unified large multimodal models (LMMs) have achieved remarkable progress in general-purpose multimodal understanding and generation. However, they still operate under a ``one-size-fits-all'' paradigm and struggle to model user-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yu Zhong , Tianwei Lin , Ruike Zhu , Yuqian Yuan , Haoyu Zheng , Liang Liang , Wenqiao Zhang , Feifei Shao , Haoyuan Li , Wanggui He , Hao Jiang , Yueting Zhuang

Text-based person retrieval aims to identify specific individuals within an image database using textual descriptions. Due to the high cost of annotation and privacy protection, researchers resort to synthesized data for the paradigm of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hang Yu , Jiahao Wen , Zhedong Zheng

Large Language Models (LLMs) have quickly become an invaluable assistant for a variety of tasks. However, their effectiveness is constrained by their ability to tailor responses to human preferences and behaviors via personalization. Prior…

Computation and Language · Computer Science 2024-11-21 Lucie Charlotte Magister , Katherine Metcalf , Yizhe Zhang , Maartje ter Hoeve

We present PersonaConvBench, a large-scale benchmark for evaluating personalized reasoning and generation in multi-turn conversations with large language models (LLMs). Unlike existing work that focuses on either personalization or…