English
Related papers

Related papers: User Preference Modeling for Conversational LLM Ag…

200 papers

Large Language Models (LLMs) have made significant progress in open-ended dialogue, yet their inability to retain and retrieve relevant information from long-term interactions limits their effectiveness in applications requiring sustained…

AI agents are commonly aligned with "human values" through reinforcement learning from human feedback (RLHF), where a single reward model is learned from aggregated human feedback and used to align an agent's behavior. However, human values…

Artificial Intelligence · Computer Science 2025-06-24 Carter Blair , Kate Larson , Edith Law

The success of recommender systems in modern online platforms is inseparable from the accurate capture of users' personal tastes. In everyday life, large amounts of user feedback data are created along with user-item online interactions in…

Machine Learning · Computer Science 2019-06-25 Xiao Zhou , Danyang Liu , Jianxun Lian , Xing Xie

The increasing demand for personalized interactions with large language models (LLMs) calls for methodologies capable of accurately and efficiently identifying user opinions and preferences. Retrieval augmentation emerges as an effective…

Computation and Language · Computer Science 2025-02-04 Chenkai Sun , Ke Yang , Revanth Gangi Reddy , Yi R. Fung , Hou Pong Chan , Kevin Small , ChengXiang Zhai , Heng Ji

In natural human-to-human conversations, participants often receive feedback signals from one another based on their follow-up reactions. These reactions can include verbal responses, facial expressions, changes in emotional state, and…

Computation and Language · Computer Science 2025-02-25 Chen Zhang , Dading Chong , Feng Jiang , Chengguang Tang , Anningzhe Gao , Guohua Tang , Haizhou Li

Visual Emotion Recognition (VER) is an important research topic due to its wide range of applications, including opinion mining and advertisement design. Extending this capability to recognize emotions at the individual level further…

Computation and Language · Computer Science 2025-09-08 Ryo Takahashi , Naoki Saito , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

The alignment between humans and machines is a critical challenge in artificial intelligence today. Reinforcement learning, which aims to maximize a reward function, is particularly vulnerable to the risks associated with poorly designed…

Artificial Intelligence · Computer Science 2025-10-29 Valentin Cuzin-Rambaud , Emilien Komlenovic , Alexandre Faure , Bruno Yun

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches…

Information Retrieval · Computer Science 2024-12-10 Minglai Shao , Hua Huang , Qiyao Peng , Hongtao Liu

Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. However, analyzing live dialogues in real-time necessitates low-latency processing…

Computation and Language · Computer Science 2025-03-10 Xuanqing Liu , Luyang Kong , Wei Niu , Afshin Khashei , Belinda Zeng , Steve Johnson , Jon Jay , Davor Golac , Matt Pope

Large Language Models (LLMs) have shown strong potential as conversational agents. Yet, their effectiveness remains limited by deficiencies in robust long-term memory, particularly in complex, long-term web-based services such as online…

Computation and Language · Computer Science 2026-02-03 Tiantian Chen , Jiaqi Lu , Ying Shen , Lin Zhang

Large language models (LLMs) have recently been adopted for recommendation by framing user preference modeling as a language generation problem. However, existing latent reasoning approaches typically represent user intent with a single…

Information Retrieval · Computer Science 2026-04-30 Tianqi Gao , Chengkai Huang , Zihan Wang , Cao Liu , Ke Zeng , Lina Yao

Reward factorization personalizes large language models (LLMs) by decomposing rewards into shared basis functions and user-specific weights. Yet, existing methods estimate user weights from scarce data in isolation and as deterministic…

Computation and Language · Computer Science 2026-04-02 Gyuseok Lee , Wonbin Kweon , Zhenrui Yue , SeongKu Kang , Jiawei Han , Dong Wang

Conventional Voice Assistants (VAs) rely on traditional language models to discern user intent and respond to their queries, leading to interactions that often lack a broader contextual understanding, an area in which Large Language Models…

Human-Computer Interaction · Computer Science 2024-12-02 Amama Mahmood , Junxiang Wang , Bingsheng Yao , Dakuo Wang , Chien-Ming Huang

Conversational recommender systems (CRS) explicitly solicit users' preferences for improved recommendations on the fly. Most existing CRS solutions count on a single policy trained by reinforcement learning for a population of users.…

Artificial Intelligence · Computer Science 2023-02-17 Zhendong Chu , Hongning Wang , Yun Xiao , Bo Long , Lingfei Wu

Recent advancements in visual language models (VLMs) have notably enhanced their capabilities in handling complex Graphical User Interface (GUI) interaction tasks. Despite these improvements, current frameworks often struggle to generate…

Computation and Language · Computer Science 2025-04-23 Zhiyuan Hu , Shiyun Xiong , Yifan Zhang , See-Kiong Ng , Anh Tuan Luu , Bo An , Shuicheng Yan , Bryan Hooi

Interactive conversational recommender systems have gained significant attention for their ability to capture user preferences through natural language interactions. However, existing approaches face substantial challenges in handling…

Artificial Intelligence · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Leveraging users' long engagement histories is essential for personalized content recommendations. The success of pretrained language models (PLMs) in NLP has led to their use in encoding user histories and candidate items, framing content…

Information Retrieval · Computer Science 2024-05-24 Chiyu Zhang , Yifei Sun , Jun Chen , Jie Lei , Muhammad Abdul-Mageed , Sinong Wang , Rong Jin , Sem Park , Ning Yao , Bo Long

The integration of Large Language Model (LLM) agents is transforming recommender systems from simple query-item matching towards deeply personalized and interactive recommendations. Reinforcement Learning (RL) provides an essential…

Reward modelling from preference data is a crucial step in aligning large language models (LLMs) with human values, requiring robust generalisation to novel prompt-response pairs. In this work, we propose to frame this problem in a causal…

Artificial Intelligence · Computer Science 2026-05-12 Katarzyna Kobalczyk , Mihaela van der Schaar

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant…

Information Retrieval · Computer Science 2025-02-12 Jian Xu , Sichun Luo , Xiangyu Chen , Haoming Huang , Hanxu Hou , Linqi Song