English
Related papers

Related papers: MTRec: Learning to Align with User Preferences via…

200 papers

Sequential recommendation aims at understanding user preference by capturing successive behavior correlations, which are usually represented as the item purchasing sequences based on their past interactions. Existing efforts generally…

Information Retrieval · Computer Science 2024-01-23 Yifang Qin , Wei Ju , Hongjun Wu , Xiao Luo , Ming Zhang

Click-based learning to rank (LTR) tackles the mismatch between click frequencies on items and their actual relevance. The approach of previous work has been to assume a model of click behavior and to subsequently introduce a method for…

Information Retrieval · Computer Science 2022-06-27 Harrie Oosterhuis

Most existing recommender systems leverage user behavior data of one type only, such as the purchase behavior in E-commerce that is directly related to the business KPI (Key Performance Indicator) of conversion rate. Besides the key…

Information Retrieval · Computer Science 2020-02-11 Chen Gao , Xiangnan He , Dahua Gan , Xiangning Chen , Fuli Feng , Yong Li , Tat-Seng Chua , Lina Yao , Yang Song , Depeng Jin

In machine learning for sequential decision-making, an algorithmic agent learns to interact with an environment while receiving feedback in the form of a reward signal. However, in many unstructured real-world settings, such a reward signal…

Machine Learning · Computer Science 2023-07-25 Ellen Novoseller , Vinicius G. Goecks , David Watkins , Josh Miller , Nicholas Waytowich

In this paper, we investigate the problem of offline Preference-based Reinforcement Learning (PbRL) with human feedback where feedback is available in the form of preference between trajectory pairs rather than explicit rewards. Our…

Machine Learning · Computer Science 2023-10-03 Wenhao Zhan , Masatoshi Uehara , Nathan Kallus , Jason D. Lee , Wen Sun

Collaborative Metric Learning (CML) recently emerged as a powerful paradigm for recommendation based on implicit feedback collaborative filtering. However, standard CML methods learn fixed user and item representations, which fails to…

Information Retrieval · Computer Science 2021-08-11 Viet-Anh Tran , Guillaume Salha-Galvan , Romain Hennequin , Manuel Moussallam

The successful integration of large language models (LLMs) into recommendation systems has proven to be a major breakthrough in recent studies, paving the way for more generic and transferable recommendations. However, LLMs struggle to…

Information Retrieval · Computer Science 2023-11-29 Junyan Qiu , Haitao Wang , Zhaolin Hong , Yiping Yang , Qiang Liu , Xingxing Wang

Interactive Recommender Systems (IRSs) have attracted a lot of attention, due to their ability to model interactive processes between users and recommender systems. Numerous approaches have adopted Reinforcement Learning (RL) algorithms, as…

Information Retrieval · Computer Science 2023-08-23 Hojoon Lee , Dongyoon Hwang , Kyushik Min , Jaegul Choo

For better user satisfaction and business effectiveness, more and more attention has been paid to the sequence-based recommendation system, which is used to infer the evolution of users' dynamic preferences, and recent studies have noticed…

Information Retrieval · Computer Science 2021-07-15 Zhi Bian , Shaojun Zhou , Hao Fu , Qihong Yang , Zhenqi Sun , Junjie Tang , Guiquan Liu , Kaikui Liu , Xiaolong Li

Micro-video recommendation aims to capture user preferences from the collaborative and context information of the interacted micro-videos, thereby predicting the appropriate videos. This target is often hindered by the inherent noise within…

Information Retrieval · Computer Science 2026-03-03 Xinxin Dong , Haokai Ma , Yuze Zheng , Yongfu Zha , Yonghui Yang , Xiaodong Wang

In real-world applications, users always interact with items in multiple aspects, such as through implicit binary feedback (e.g., clicks, dislikes, long views) and explicit feedback (e.g., comments, reviews). Modern recommendation systems…

Information Retrieval · Computer Science 2025-08-26 Shuo Yang , Jiangxia Cao , Haipeng Li , Yuqi Mao , Shuchao Pang

Reinforcement Learning-based recommender systems (RLRS) offer an effective way to handle sequential recommendation tasks but often face difficulties in real-world settings, where user feedback data can be sub-optimal or sparse. In this…

Information Retrieval · Computer Science 2025-10-16 Xiaocong Chen , Siyu Wang , Lina Yao

Sequential recommendation (SR) models often capture user preferences based on the historically interacted item IDs, which usually obtain sub-optimal performance when the interaction history is limited. Content-based sequential…

Information Retrieval · Computer Science 2025-10-20 Donglin Zhou , Weike Pan , Zhong Ming

Click-Through Rate (CTR) prediction, a core task in recommendation systems, estimates user click likelihood using historical behavioral data. Modeling user behavior sequences as text to leverage Language Models (LMs) for this task has…

Computation and Language · Computer Science 2025-08-06 Zixuan Li , Binzong Geng , Jing Xiong , Yong He , Yuxuan Hu , Jian Chen , Dingwei Chen , Xiyu Chang , Liang Zhang , Linjian Mo , Chengming Li , Chuan Yuan , Zhenan Sun

Reactions such as gestures, facial expressions, and vocalizations are an abundant, naturally occurring channel of information that humans provide during interactions. A robot or other agent could leverage an understanding of such implicit…

Human-Computer Interaction · Computer Science 2020-12-08 Yuchen Cui , Qiping Zhang , Alessandro Allievi , Peter Stone , Scott Niekum , W. Bradley Knox

Sequential recommenders that are trained on implicit feedback are usually learned as a multi-class classification task through softmax-based loss functions on one-hot class labels. However, one-hot training labels are sparse and may lead to…

Information Retrieval · Computer Science 2023-11-07 Shiguang Wu , Xin Xin , Pengjie Ren , Zhumin Chen , Jun Ma , Maarten de Rijke , Zhaochun Ren

An ultimate goal of recommender systems (RS) is to improve user engagement. Reinforcement learning (RL) is a promising paradigm for this goal, as it directly optimizes overall performance of sequential recommendation. However, many existing…

Information Retrieval · Computer Science 2023-04-06 Guoxi Zhang , Xing Yao , Xuanji Xiao

In the realm of music recommendation, sequential recommender systems have shown promise in capturing the dynamic nature of music consumption. Nevertheless, traditional Transformer-based models, such as SASRec and BERT4Rec, while effective,…

Information Retrieval · Computer Science 2024-09-09 Davide Abbattista , Vito Walter Anelli , Tommaso Di Noia , Craig Macdonald , Aleksandr Vladimirovich Petrov

Selection bias is prevalent in the data for training and evaluating recommendation systems with explicit feedback. For example, users tend to rate items they like. However, when rating an item concerning a specific user, most of the…

Information Retrieval · Computer Science 2021-09-14 Weishen Pan , Sen Cui , Hongyi Wen , Kun Chen , Changshui Zhang , Fei Wang

In practical scenarios, the effectiveness of sequential recommendation systems is hindered by the user cold-start problem, which arises due to limited interactions for accurately determining user preferences. Previous studies have attempted…

Information Retrieval · Computer Science 2023-07-27 Mohammmadmahdi Maheri , Reza Abdollahzadeh , Bardia Mohammadi , Mina Rafiei , Jafar Habibi , Hamid R. Rabiee