English
Related papers

Related papers: Vague Preference Policy Learning for Conversationa…

200 papers

In the realm of recommendation systems, users exhibit a diverse array of behaviors when interacting with items. This phenomenon has spurred research into learning the implicit semantic relationships between these behaviors to enhance…

Information Retrieval · Computer Science 2024-08-22 Hao Wang , Yongqiang Han , Kefan Wang , Kai Cheng , Zhen Wang , Wei Guo , Yong Liu , Defu Lian , Enhong Chen

Conversational recommendation systems (CRS) engage with users by inferring user preferences from dialog history, providing accurate recommendations, and generating appropriate responses. Previous CRSs use knowledge graph (KG) based…

Computation and Language · Computer Science 2021-12-16 Bowen Yang , Cong Han , Yu Li , Lei Zuo , Zhou Yu

Preference-based reinforcement learning (PbRL) bypasses explicit reward engineering by inferring reward functions from human preference comparisons, enabling better alignment with human intentions. However, humans often struggle to label a…

Machine Learning · Computer Science 2025-06-11 Ni Mu , Hao Hu , Xiao Hu , Yiqin Yang , Bo Xu , Qing-Shan Jia

Conversational Recommender Systems (CRSs) engage users in multi-turn interactions to deliver personalized recommendations. The emergence of large language models (LLMs) further enhances these systems by enabling more natural and dynamic…

Computation and Language · Computer Science 2025-04-18 Xiaoyan Zhao , Yang Deng , Wenjie Wang , Hongzhan lin , Hong Cheng , Rui Zhang , See-Kiong Ng , Tat-Seng Chua

Recommender systems can automatically recommend users with items that they probably like. The goal of them is to model the user-item interaction by effectively representing the users and items. Existing methods have primarily learned the…

Information Retrieval · Computer Science 2024-04-30 Xue Dong , Xuemeng Song , Na Zheng , Yinwei Wei , Zhongzhou Zhao

Conversational recommender systems (CRS) aim to recommend suitable items to users through natural language conversations. For developing effective CRSs, a major technical issue is how to accurately infer user preference from very limited…

Computation and Language · Computer Science 2023-05-31 Yuanhang Zhou , Kun Zhou , Wayne Xin Zhao , Cheng Wang , Peng Jiang , He Hu

Conversational recommender systems (CRS) explicitly solicit users' preferences for improved recommendations on the fly. Most existing CRS solutions count on a single policy trained by reinforcement learning for a population of users.…

Artificial Intelligence · Computer Science 2023-02-17 Zhendong Chu , Hongning Wang , Yun Xiao , Bo Long , Lingfei Wu

Conversational Recommender Systems (CRSs)aim to engage users in dialogue to provide tailored recommendations. While traditional CRSs focus on eliciting preferences and retrieving items, real-world e-commerce interactions involve more…

Information Retrieval · Computer Science 2025-08-08 Tongyoung Kim , Jeongeun Lee , Soojin Yoon , Sunghwan Kim , Dongha Lee

Recent approaches in Conversational Recommender Systems (CRSs) have tried to simulate real-world users engaging in conversations with CRSs to create more realistic testing environments that reflect the complexity of human-agent dialogue.…

Information Retrieval · Computer Science 2025-10-23 Sunghwan Kim , Kwangwook Seo , Tongyoung Kim , Jinyoung Yeo , Dongha Lee

We propose a learning approach for turn-level spoken language understanding, which facilitates a user to speak one or more utterances compositionally in a turn for completing a task (e.g., voice ordering). A typical pipelined approach for…

Computation and Language · Computer Science 2019-06-12 Hao Lang , Wen Wang

Direct Preference Optimization (DPO) trains a language model using human preference data, bypassing the explicit reward modeling phase of Reinforcement Learning from Human Feedback (RLHF). By iterating over sentence pairs in a preference…

Machine Learning · Computer Science 2024-10-31 Jae Hyeon Cho , Minkyung Park , Byung-Jun Lee

Contrastive learning has demonstrated promising potential in recommender systems. Existing methods typically construct sparser views by randomly perturbing the original interaction graph, as they have no idea about the authentic user…

Information Retrieval · Computer Science 2025-12-19 Xufeng Liang , Zhida Qin , Chong Zhang , Tianyu Huang , Gangyi Ding

Policy-based reinforcement learning currently plays an important role in improving LLMs on mathematical reasoning tasks. However, existing rollout-based reinforcement learning methods (GRPO, DAPO, GSPO, etc.) fail to explicitly consider…

Machine Learning · Computer Science 2025-09-25 Guochao Jiang , Wenfeng Feng , Guofeng Quan , Chuzhan Hao , Yuewei Zhang , Guohua Liu , Hao Wang

Conversational recommender systems (CRS) enable users to articulate their preferences and provide feedback through natural language. With the advent of large language models (LLMs), the potential to enhance user engagement with CRS and…

Human-Computer Interaction · Computer Science 2024-05-24 Yizhe Zhang , Yucheng Jin , Li Chen , Ting Yang

In e-commerce platforms, the relevant recommendation is a unique scenario providing related items for a trigger item that users are interested in. However, users' preferences for the similarity and diversity of recommendation results are…

Information Retrieval · Computer Science 2023-08-22 Wei Dai , Yingmin Su , Xiaofeng Pan

Conversational Recommender Systems (CRSs) in E-commerce platforms aim to recommend items to users via multiple conversational interactions. Click-through rate (CTR) prediction models are commonly used for ranking candidate items. However,…

Information Retrieval · Computer Science 2021-05-03 Chi-Man Wong , Fan Feng , Wen Zhang , Chi-Man Vong , Hui Chen , Yichi Zhang , Peng He , Huan Chen , Kun Zhao , Huajun Chen

Conversational Recommender Systems (CRSs) aim to provide personalized recommendations by capturing user preferences through interactive dialogues. Explainability in CRSs is crucial as it enables users to understand the reasoning behind…

Computation and Language · Computer Science 2025-10-03 Zhangchi Qiu , Linhao Luo , Shirui Pan , Alan Wee-Chung Liew

We present Preference Flow Matching (PFM), a new framework for preference-based reinforcement learning (PbRL) that streamlines the integration of preferences into an arbitrary class of pre-trained models. Existing PbRL methods require…

Machine Learning · Computer Science 2024-10-29 Minu Kim , Yongsik Lee , Sehyeok Kang , Jihwan Oh , Song Chong , Se-Young Yun

Can Visual Language Models (VLMs) effectively capture human visual preferences? This work addresses this question by training VLMs to think about preferences at test time, employing reinforcement learning methods inspired by DeepSeek R1 and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Alexander Gambashidze , Konstantin Sobolev , Andrey Kuznetsov , Ivan Oseledets

The visual dialog task requires an AI agent to interact with humans in multi-round dialogs based on a visual environment. As a common linguistic phenomenon, pronouns are often used in dialogs to improve the communication efficiency. As a…

Computation and Language · Computer Science 2022-05-31 Xintong Yu , Hongming Zhang , Ruixin Hong , Yangqiu Song , Changshui Zhang