English
Related papers

Related papers: User Preference Modeling for Conversational LLM Ag…

200 papers

Reinforcement learning (RL) has shown great promise in optimizing long-term user interest in recommender systems. However, existing RL-based recommendation methods need a large number of interactions for each user to learn a robust…

Machine Learning · Computer Science 2020-12-07 Yanan Wang , Yong Ge , Li Li , Rui Chen , Tong Xu

Actively inferring user preferences, for example by asking good questions, is important for any human-facing decision-making system. Active inference allows such systems to adapt and personalize themselves to nuanced individual preferences.…

Computation and Language · Computer Science 2024-06-27 Wasu Top Piriyakulkij , Volodymyr Kuleshov , Kevin Ellis

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning, generalization, and simulating human-like behavior across a wide range of tasks. These strengths present new opportunities to enhance traditional…

Information Retrieval · Computer Science 2025-12-01 Nachiket Subbaraman , Jaskinder Sarai , Aniruddh Nath , Lichan Hong , Lukasz Heldt , Li Wei , Zhe Zhao

With the large language model showing human-like logical reasoning and understanding ability, whether agents based on the large language model can simulate the interaction behavior of real users, so as to build a reliable virtual…

Information Retrieval · Computer Science 2024-03-05 Chenwei Zhang , Wenran Lu , Chunhe Ni , Hongbo Wang , Jiang Wu

Large language models (LLMs) have evolved into interactive agents that collaborate with users in real-world tasks. Effective collaboration in such settings increasingly depends on understanding the user beyond what is explicitly stated, as…

Artificial Intelligence · Computer Science 2026-05-27 Yuxin Chen , Yi Zhang , Zhengzhou Cai , Yaorui Shi , Zhiyuan Yao , Chenhang Cui , Jingnan Zheng , Yaqi Huo , Xi Su , Qi Gu , Xunliang Cai , Xiang Wang , An Zhang , Tat-Seng Chua

Multi-Agent Reinforcement Learning (MARL) has shown promise in solving complex problems involving cooperation and competition among agents, such as an Unmanned Surface Vehicle (USV) swarm used in search and rescue, surveillance, and vessel…

Multiagent Systems · Computer Science 2025-03-10 Hyeonjun Kim , Kanghoon Lee , Junho Park , Jiachen Li , Jinkyoo Park

In this paper, we study the problem of modeling users' diverse interests. Previous methods usually learn a fixed user representation, which has a limited ability to represent distinct interests of a user. In order to model users' various…

Information Retrieval · Computer Science 2018-05-21 Lei Zheng , Chun-Ta Lu , Lifang He , Sihong Xie , Vahid Noroozi , He Huang , Philip S. Yu

Agentic reinforcement learning (Agentic RL) has achieved strong progress in tasks with clear success signals. However, many real-world agent applications require user-conditioned behavior: the same query may call for different planning…

Computation and Language · Computer Science 2026-05-25 Ranxu zhang , zeyang li , Jiacheng Huang , Rui Zhang , Xiaozhou Xu , sun zhe , Yanyong Zhang , Chao Wang

Offline reinforcement learning (RL) provides a powerful framework for training robotic agents using pre-collected, suboptimal datasets, eliminating the need for costly, time-consuming, and potentially hazardous online interactions. This is…

Machine Learning · Computer Science 2025-08-01 Tung M. Luu , Donghoon Lee , Younghwan Lee , Chang D. Yoo

Can Visual Language Models (VLMs) effectively capture human visual preferences? This work addresses this question by training VLMs to think about preferences at test time, employing reinforcement learning methods inspired by DeepSeek R1 and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Alexander Gambashidze , Konstantin Sobolev , Andrey Kuznetsov , Ivan Oseledets

Nowadays, Large Language Models (LLMs) have shown exceptional performance in sequential recommendations, and the adoption of LLM-based recommender systems (LLMRec) is becoming increasingly widespread in existing e-commerce platforms.…

Information Retrieval · Computer Science 2025-11-21 Hao Liu , Le Wu , Min Hou , Han Wu , Kun Zhang , Xin Li , Si Wei

Reinforcement learning from human feedback usually models preferences using a reward function that does not distinguish between people. We argue that this is unlikely to be a good design choice in contexts with high potential for…

User preference learning is generally a hard problem. Individual preferences are typically unknown even to users themselves, while the space of choices is infinite. Here we study user preference learning from information-theoretic…

Machine Learning · Computer Science 2023-11-27 Tanya Ignatenko , Kirill Kondrashov , Marco Cox , Bert de Vries

Video recommender systems are among the most popular and impactful applications of AI, shaping content consumption and influencing culture for billions of users. Traditional single-model recommenders, which optimize static engagement…

Information Retrieval · Computer Science 2026-04-03 Srivaths Ranganathan , Abhishek Dharmaratnakar , Anushree Sinha , Debanshu Das

Multimodal Large Language Models (MLLMs) serve as daily assistants for millions. However, their ability to generate responses aligned with individual preferences remains limited. Prior approaches enable only static, single-turn…

Computation and Language · Computer Science 2026-04-16 Chang Nie , Chaoyou Fu , Yifan Zhang , Haihua Yang , Caifeng Shan

Understanding human preferences is crucial for improving foundation models and building personalized AI systems. However, preferences are inherently diverse and complex, making it difficult for traditional reward models to capture their…

Artificial Intelligence · Computer Science 2025-06-12 Feng Luo , Rui Yang , Hao Sun , Chunyuan Deng , Jiarui Yao , Jingyan Shen , Huan Zhang , Hanjie Chen

Evaluating instruction-guided image edits requires rewards that reflect subtle human preferences, yet current reward models typically depend on large-scale preference annotation and additional model training. This creates a data-efficiency…

Researchers have been studying approaches to steer the behavior of Large Language Models (LLMs) and build personalized LLMs tailored for various applications. While fine-tuning seems to be a direct solution, it requires substantial…

Computation and Language · Computer Science 2024-07-31 Yuanpu Cao , Tianrong Zhang , Bochuan Cao , Ziyi Yin , Lu Lin , Fenglong Ma , Jinghui Chen

Current advances in recommender systems have been remarkably successful in optimizing immediate engagement. However, long-term user engagement, a more desirable performance metric, remains difficult to improve. Meanwhile, recent…

Information Retrieval · Computer Science 2023-06-05 Wanqi Xue , Qingpeng Cai , Zhenghai Xue , Shuo Sun , Shuchang Liu , Dong Zheng , Peng Jiang , Kun Gai , Bo An

Reinforcement Learning from Human Feedback (RLHF) has become the standard for aligning Large Language Models (LLMs), yet its efficacy is bottlenecked by the high cost of acquiring preference data, especially in low-resource and expert…

Machine Learning · Computer Science 2026-03-11 Davit Melikidze , Marian Schneider , Jessica Lam , Martin Wertich , Ido Hakimi , Barna Pásztor , Andreas Krause