English
Related papers

Related papers: EpiPersona: Persona Projection and Episode Couplin…

200 papers

Multi-session persona-based dialogue generation presents challenges in maintaining long-term consistency and generating diverse, personalized responses. While large language models (LLMs) excel in single-session dialogues, they struggle to…

Computation and Language · Computer Science 2025-11-06 Yi-Pei Chen , Noriki Nishida , Hideki Nakayama , Yuji Matsumoto

Large Language Models (LLMs) have made it possible for recommendation systems to interact with users in open-ended conversational interfaces. In order to personalize LLM responses, it is crucial to elicit user preferences, especially when…

Artificial Intelligence · Computer Science 2025-10-15 Ali Montazeralghaem , Guy Tennenholtz , Craig Boutilier , Ofer Meshi

An important aspect of developing LLMs that interact with humans is to align models' behavior to their users. It is possible to prompt an LLM into behaving as a certain persona, especially a user group or ideological persona the model…

Computation and Language · Computer Science 2023-05-25 EunJeong Hwang , Bodhisattwa Prasad Majumder , Niket Tandon

Large language models (LLMs) have demonstrated promising performance in various financial applications, though their potential in complex investment strategies remains underexplored. To address this gap, we investigate how LLMs can predict…

Computational Engineering, Finance, and Science · Computer Science 2024-12-02 Yoshia Abe , Shuhei Matsuo , Ryoma Kondo , Ryohei Hisano

While Reinforcement Learning from Human Feedback (RLHF) is widely used to align Large Language Models (LLMs) with human preferences, it typically assumes homogeneous preferences across users, overlooking diverse human values and minority…

Computation and Language · Computer Science 2025-10-28 Yijiang River Dong , Tiancheng Hu , Yinhong Liu , Ahmet Üstün , Nigel Collier

Aligning LLM-based judges with human preferences is a significant challenge, as they are difficult to calibrate and often suffer from rubric sensitivity, bias, and instability. Overcoming this challenge advances key applications, such as…

Large Language Models (LLMs) are increasingly used as chatbots, yet their ability to personalize responses to user preferences remains limited. We introduce PrefEval, a benchmark for evaluating LLMs' ability to infer, memorize and adhere to…

Machine Learning · Computer Science 2025-02-14 Siyan Zhao , Mingyi Hong , Yang Liu , Devamanyu Hazarika , Kaixiang Lin

Current methods for personality control in Large Language Models rely on static prompting or expensive fine-tuning, failing to capture the dynamic and compositional nature of human traits. We introduce PERSONA, a training-free framework…

Artificial Intelligence · Computer Science 2026-02-18 Xiachong Feng , Liang Zhao , Weihong Zhong , Yichong Huang , Yuxuan Gu , Lingpeng Kong , Xiaocheng Feng , Bing Qin

Current large language model (LLM) development treats task-solving and preference-alignment as separate challenges, optimizing first for objective correctness, then for alignment to aggregated human preferences. This paradigm fails in…

Computation and Language · Computer Science 2026-03-06 Shuyue Stella Li , Avinandan Bose , Faeze Brahman , Simon Shaolei Du , Pang Wei Koh , Maryam Fazel , Yulia Tsvetkov

Recent advancements in large language models (LLMs) have significantly boosted the rise of Role-Playing Language Agents (RPLAs), i.e., specialized AI systems designed to simulate assigned personas. By harnessing multiple advanced abilities…

Behavioral logs provide rich signals for user modeling, but are noisy and interleaved across diverse intents. Recent work uses LLMs to generate interpretable natural-language personas from user logs, yet evaluation often emphasizes…

Artificial Intelligence · Computer Science 2026-04-30 Nayoung Choi , Haeyu Jeong , Changbong Kim , Hongjun Lim , Jinho D. Choi

Current Large Language Models (LLMs) excel in general reasoning yet struggle with specialized tasks requiring proprietary or domain-specific knowledge. Fine-tuning large models for every niche application is often infeasible due to…

Artificial Intelligence · Computer Science 2025-04-23 Yizhu Jiao , Xuchao Zhang , Zhaoyang Wang , Yubo Ma , Zhun Deng , Rujia Wang , Chetan Bansal , Saravan Rajmohan , Jiawei Han , Huaxiu Yao

Large language model (LLM) personalization aims to align model outputs with individuals' unique preferences and opinions. While recent efforts have implemented various personalization methods, a unified theoretical framework that can…

Computation and Language · Computer Science 2025-09-30 Xinliang Frederick Zhang , Nick Beauchamp , Lu Wang

Large Language Models (LLMs) have succeeded considerably in In-Context-Learning (ICL) based summarization. However, saliency is subject to the users' specific preference histories. Hence, we need reliable In-Context Personalization Learning…

Computation and Language · Computer Science 2024-10-02 Divya Patel , Pathik Patel , Ankush Chander , Sourish Dasgupta , Tanmoy Chakraborty

Large Language Model (LLM) empowered agents have recently emerged as advanced paradigms that exhibit impressive capabilities in a wide range of domains and tasks. Despite their potential, current LLM agents often adopt a one-size-fits-all…

Personality analysis from online short videos has gained prominence due to its applications in personalized recommendation systems, sentiment analysis, and human-computer interaction. Traditional assessment methods, such as questionnaires…

Multimedia · Computer Science 2024-11-05 Sixu An , Xiangguo Sun , Yicong Li , Yu Yang , Guandong Xu

Personalizing large language models (LLMs) is essential for delivering tailored interactions that improve user experience. Many existing personalization methods require fine-tuning LLMs for each user, rendering them prohibitively expensive…

Machine Learning · Computer Science 2025-03-06 Yijing Zhang , Dyah Adila , Changho Shin , Frederic Sala

Traditional alignment methods for Large Vision and Language Models (LVLMs) primarily rely on human-curated preference data. Human-generated preference data is costly; machine-generated preference data is limited in quality; and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Jefferson Hernandez , Jing Shi , Simon Jenni , Vicente Ordonez , Kushal Kafle

Reward modelling from preference data is a crucial step in aligning large language models (LLMs) with human values, requiring robust generalisation to novel prompt-response pairs. In this work, we propose to frame this problem in a causal…

Artificial Intelligence · Computer Science 2026-05-12 Katarzyna Kobalczyk , Mihaela van der Schaar

While black-box large language models are widely deployed, they produce generic outputs that overlook individual user preferences. Current personalization methods are fundamentally limited to response-level personalization; they only match…

Computation and Language · Computer Science 2026-03-03 Jieyong Kim , Tongyoung Kim , Soojin Yoon , Jaehyung Kim , Dongha Lee