English
Related papers

Related papers: Sequential Learning over Implicit Feedback for Rob…

200 papers

Sequential recommendation (SR) models often capture user preferences based on the historically interacted item IDs, which usually obtain sub-optimal performance when the interaction history is limited. Content-based sequential…

Information Retrieval · Computer Science 2025-10-20 Donglin Zhou , Weike Pan , Zhong Ming

The essence of sequential recommender systems (RecSys) lies in understanding how users make decisions. Most existing approaches frame the task as sequential prediction based on users' historical purchase records. While effective in…

Information Retrieval · Computer Science 2024-09-11 Xiaoyu Liu , Jiaxin Yuan , Yuhang Zhou , Jingling Li , Furong Huang , Wei Ai

Sequential recommendation models, models that learn from chronological user-item interactions, outperform traditional recommendation models in many settings. Despite the success of sequential recommendation models, their robustness has…

Information Retrieval · Computer Science 2024-01-17 Juntao Tan , Shelby Heinecke , Zhiwei Liu , Yongjun Chen , Yongfeng Zhang , Huan Wang

In web search and recommendation systems, user clicks are widely used to train ranking models. However, click data is heavily biased, i.e., users tend to click higher-ranked items (position bias), choose only what was shown to them…

Artificial Intelligence · Computer Science 2026-01-12 Haoming Gong , Qingyao Ai , Zhihao Tao , Yongfeng Zhang

Learning from implicit user feedback is challenging as we can only observe positive samples but never access negative ones. Most conventional methods cope with this issue by adopting a pairwise ranking approach with negative sampling.…

Information Retrieval · Computer Science 2021-01-20 Riku Togashi , Masahiro Kato , Mayu Otani , Shin'ichi Satoh

Generally speaking, the model training for recommender systems can be based on two types of data, namely explicit feedback and implicit feedback. Moreover, because of its general availability, we see wide adoption of implicit feedback data,…

Information Retrieval · Computer Science 2023-04-17 Yi Ren , Hongyan Tang , Jiangpeng Rong , Siwen Zhu

Sequential Recommendation Systems (SRS) have become essential in many real-world applications. However, existing SRS methods often rely on collaborative filtering signals and fail to capture real-time user preferences, while Conversational…

Information Retrieval · Computer Science 2025-09-12 Yifan Wang , Shen Gao , Jiabao Fang , Rui Yan , Billy Chiu , Shuo Shang

Recently, sequential recommendation has emerged as a widely studied topic. Existing researches mainly design effective neural architectures to model user behavior sequences based on item IDs. However, this kind of approach highly relies on…

Information Retrieval · Computer Science 2022-06-07 Shanlei Mu , Yupeng Hou , Wayne Xin Zhao , Yaliang Li , Bolin Ding

The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions often lead to inefficient or suboptimal policies and may not be aligned with user values. Reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-24 Muhan Lin , Shuyang Shi , Yue Guo , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Simon Stepputtis , Joseph Campbell , Katia Sycara

Large scale recommender models find most relevant items from huge catalogs, and they play a critical role in modern search and recommendation systems. To model the input space with large-vocab categorical features, a typical recommender…

Sequential recommenders have made great strides in capturing a user's preferences. Nevertheless, the cold-start recommendation remains a fundamental challenge as they typically involve limited user-item interactions for personalization.…

Information Retrieval · Computer Science 2023-08-22 Minchang Kim , Yongjin Yang , Jung Hyun Ryu , Taesup Kim

Recent advances in graph-based learning approaches have demonstrated their effectiveness in modelling users' preferences and items' characteristics for Recommender Systems (RSS). Most of the data in RSS can be organized into graphs where…

Information Retrieval · Computer Science 2023-03-15 Lemei Zhang , Peng Liu , Jon Atle Gulla

Modeling user sequential behaviors has recently attracted increasing attention in the recommendation domain. Existing methods mostly assume coherent preference in the same sequence. However, user personalities are volatile and easily…

Information Retrieval · Computer Science 2022-04-01 Weiqi Shao , Xu Chen , Long Xia , Jiashu Zhao , Dawei Yin

Interactive Recommender Systems (IRSs) have attracted a lot of attention, due to their ability to model interactive processes between users and recommender systems. Numerous approaches have adopted Reinforcement Learning (RL) algorithms, as…

Information Retrieval · Computer Science 2023-08-23 Hojoon Lee , Dongyoon Hwang , Kyushik Min , Jaegul Choo

Recommendation models are predominantly trained using implicit user feedback, since explicit feedback is often costly to obtain. However, implicit feedback, such as clicks, does not always reflect users' real preferences. For example, a…

Information Retrieval · Computer Science 2025-10-06 Mengchen Zhao , Yifan Gao , Yaqing Hou , Xiangyang Li , Pengjie Gu , Zhenhua Dong , Ruiming Tang , Yi Cai

While many production-ready and robust algorithms are available for the task of recommendation systems, many of these systems do not take the order of user's consumption into account. The order of consumption can be very useful and matters…

Information Retrieval · Computer Science 2022-05-03 Mehdi Soleiman Nejad , Meysam Varasteh , Hadi Moradi , Mohammad Amin Sadeghi

Model-free RL-based recommender systems have recently received increasing research attention due to their capability to handle partial feedback and long-term rewards. However, most existing research has ignored a critical feature in…

Machine Learning · Computer Science 2023-08-28 Tianchi Cai , Shenliao Bao , Jiyan Jiang , Shiji Zhou , Wenpeng Zhang , Lihong Gu , Jinjie Gu , Guannan Zhang

For ambiguous queries, conventional retrieval systems are bound by two conflicting goals. On the one hand, they should diversify and strive to present results for as many query intents as possible. On the other hand, they should provide…

Information Retrieval · Computer Science 2015-03-19 Karthik Raman , Thorsten Joachims , Pannaga Shivaswamy

Continual learning aims to learn on non-stationary data streams without catastrophically forgetting previous knowledge. Prevalent replay-based methods address this challenge by rehearsing on a small buffer holding the seen data, for which a…

Machine Learning · Computer Science 2023-04-21 Zhicheng Sun , Yadong Mu , Gang Hua

Sequential recommendation (SR) learns from the temporal dynamics of user-item interactions to predict the next ones. Fairness-aware recommendation mitigates a variety of algorithmic biases in the learning of user preferences. This paper…

Information Retrieval · Computer Science 2022-05-03 Cheng-Te Li , Cheng Hsu , Yang Zhang