English
Related papers

Related papers: Vague Preference Policy Learning for Conversationa…

200 papers

Conversational recommender systems (CRSs) capture user preference through textual information in dialogues. However, they suffer from data sparsity on two fronts: the dialogue space is vast and linguistically diverse, while the item space…

Information Retrieval · Computer Science 2025-07-02 Sixiao Zhang , Mingrui Liu , Cheng Long , Wei Yuan , Hongxu Chen , Xiangyu Zhao , Hongzhi Yin

Conventional sequential recommendation models have achieved remarkable success in mining implicit behavioral patterns. However, these architectures remain structurally blind to explicit user intent: they struggle to adapt when a user's…

Information Retrieval · Computer Science 2026-03-06 Fuyuan Lyu , Chenglin Luo , Qiyuan Zhang , Yupeng Hou , Haolun Wu , Xing Tang , Xue Liu , Jin L. C. Guo , Xiuqiang He

Iterative data generation and model re-training can effectively align large language models(LLMs) to human preferences. The process of data sampling is crucial, as it significantly influences the success of policy improvement. Repeated…

Computation and Language · Computer Science 2024-10-07 Hai Ye , Hwee Tou Ng

Conversational Recommendation Systems (CRSs) have recently started to leverage pretrained language models (LM) such as BERT for their ability to semantically interpret a wide range of preference statement variations. However, pretrained LMs…

Information Retrieval · Computer Science 2022-01-20 Tianshu Shen , Jiaru Li , Mohamed Reda Bouadjenek , Zheda Mai , Scott Sanner

Generative Recommenders (GRs), exemplified by the Hierarchical Sequential Transduction Unit (HSTU), have emerged as a powerful paradigm for modeling long user interaction sequences. However, we observe that their "flat-sequence" assumption…

Information Retrieval · Computer Science 2026-03-03 Zerui Chen , Heng Chang , Tianying Liu , Chuantian Zhou , Yi Cao , Jiandong Ding , Ming Liu , Bing Qin

Cross-domain recommendation offers a potential avenue for alleviating data sparsity and cold-start problems. Embedding and mapping, as a classic cross-domain research genre, aims to identify a common mapping function to perform…

Information Retrieval · Computer Science 2024-06-25 Chuang Zhao , Hongke Zhao , Ming He , Xiaomeng Li , Jianping Fan

A conversational recommender system (CRS) is a practical application for item recommendation through natural language conversation. Such a system estimates user interests for appropriate personalized recommendations. Users sometimes have…

Computation and Language · Computer Science 2023-03-02 Yuka Okuda , Katsuhito Sudoh , Seitaro Shinagawa , Satoshi Nakamura

Prerequisites can play a crucial role in users' decision-making yet recommendation systems have not fully utilized such contextual background knowledge. Traditional recommendation systems (RS) mostly enrich user-item interactions where the…

Information Retrieval · Computer Science 2022-09-26 Hengchang Hu , Liangming Pan , Yiding Ran , Min-Yen Kan

Preference-based reinforcement learning (PbRL) is emerging as a promising approach to teaching robots through human comparative feedback, sidestepping the need for complex reward engineering. However, the substantial volume of feedback…

Robotics · Computer Science 2025-01-09 Ruiqi Wang , Dezhong Zhao , Ziqin Yuan , Ike Obi , Byung-Cheol Min

Recommender systems aim to predict personalized rankings based on user preference data. With the rise of Language Models (LMs), LM-based recommenders have been widely explored due to their extensive world knowledge and powerful reasoning…

Information Retrieval · Computer Science 2024-11-08 Yuxin Chen , Junfei Tan , An Zhang , Zhengyi Yang , Leheng Sheng , Enzhi Zhang , Xiang Wang , Tat-Seng Chua

Large vision-language models (LVLMs) often fail to align with human preferences, leading to issues like generating misleading content without proper visual context (also known as hallucination). A promising solution to this problem is using…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Chenglong Wang , Yang Gan , Yifu Huo , Yongyu Mu , Murun Yang , Qiaozhi He , Tong Xiao , Chunliang Zhang , Tongran Liu , Quan Du , Di Yang , Jingbo Zhu

In our work, we explore the synergistic capabilities of pre-trained vision-and-language models (VLMs) and large language models (LLMs) on visual commonsense reasoning (VCR) problems. We find that VLMs and LLMs-based decision pipelines are…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Kaiwen Zhou , Kwonjoon Lee , Teruhisa Misu , Xin Eric Wang

Sequential recommendation (SR) aims to predict the subsequent behaviors of users by understanding their successive historical behaviors. Recently, some methods for SR are devoted to alleviating the data sparsity problem (i.e., limited…

Information Retrieval · Computer Science 2022-08-30 Ziyang Wang , Huoyu Liu , Wei Wei , Yue Hu , Xian-Ling Mao , Shaojian He , Rui Fang , Dangyang chen

Preference-based Reinforcement Learning (PbRL) is a paradigm in which an RL agent learns to optimize a task using pair-wise preference-based feedback over trajectories, rather than explicit reward signals. While PbRL has demonstrated…

Machine Learning · Computer Science 2024-04-18 Wenhao Zhan , Masatoshi Uehara , Wen Sun , Jason D. Lee

Conversational recommendation systems (CRS) aim to recommend suitable items to users through natural language conversation. However, most CRS approaches do not effectively utilize the signal provided by these conversations. They rely…

Computation and Language · Computer Science 2023-05-24 Raghav Gupta , Renat Aksitov , Samrat Phatale , Simral Chaudhary , Harrison Lee , Abhinav Rastogi

Large language models (LLMs) have attracted significant attention in recommendation systems. Current work primarily applies supervised fine-tuning (SFT) to adapt the model for recommendation tasks. However, SFT on positive examples only…

Information Retrieval · Computer Science 2025-02-07 Chongming Gao , Ruijun Chen , Shuai Yuan , Kexin Huang , Yuanqing Yu , Xiangnan He

Multi-prompt learning methods have emerged as an effective approach for facilitating the rapid adaptation of vision-language models to downstream tasks with limited resources. Existing multi-prompt learning methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Fei Song , Yi Li , Jiangmeng Li , Rui Wang , Changwen Zheng , Fanjiang Xu , Hui Xiong

Implicit feedback (e.g., clicks, dwell times, etc.) is an abundant source of data in human-interactive systems. While implicit feedback has many advantages (e.g., it is inexpensive to collect, user centric, and timely), its inherent biases…

Information Retrieval · Computer Science 2016-08-17 Thorsten Joachims , Adith Swaminathan , Tobias Schnabel

Recommender systems for software engineering (RSSE) play a crucial role in automating development tasks by providing relevant suggestions according to the developer's context. However, they suffer from the so-called popularity bias, i.e.,…

Software Engineering · Computer Science 2025-01-20 Claudio Di Sipio , Juri Di Rocco , Davide Di Ruscio , Vladyslav Bulhakov

Conversational Recommender Systems (CRSs) have emerged as a transformative paradigm for offering personalized recommendations through natural language dialogue. However, they face challenges with knowledge sparsity, as users often provide…

Computation and Language · Computer Science 2025-03-11 Zhangchi Qiu , Linhao Luo , Zicheng Zhao , Shirui Pan , Alan Wee-Chung Liew