English
Related papers

Related papers: Sliding Window Training -- Utilizing Historical Re…

200 papers

In many sequential tasks, a model needs to remember relevant events from the distant past to make correct predictions. Unfortunately, a straightforward application of gradient based training requires intermediate computations to be stored…

Machine Learning · Computer Science 2023-08-14 Artyom Sorokin , Nazar Buzun , Leonid Pugachev , Mikhail Burtsev

Real-world recommendation systems commonly offer diverse content scenarios for users to interact with. Considering the enormous number of users in industrial platforms, it is infeasible to utilize a single unified recommendation model to…

Information Retrieval · Computer Science 2024-12-10 Chonggang Song , Chunxu Shen , Hao Gu , Yaoming Wu , Lingling Yi , Jie Wen , Chuan Chen

Training reinforcement learning agents with human feedback is crucial when task objectives are difficult to specify through dense reward functions. While prior methods rely on offline trajectory comparisons to elicit human preferences, such…

Machine Learning · Computer Science 2025-10-08 Zhengran Ji , Boyuan Chen

Sequential recommendation aims to model dynamic user behavior from historical interactions. Existing methods rely on either explicit item IDs or general textual features for sequence modeling to understand user preferences. While promising,…

Information Retrieval · Computer Science 2023-05-30 Jiacheng Li , Ming Wang , Jin Li , Jinmiao Fu , Xin Shen , Jingbo Shang , Julian McAuley

Capturing the dynamics in user preference is crucial to better predict user future behaviors because user preferences often drift over time. Many existing recommendation algorithms -- including both shallow and deep ones -- often model such…

Information Retrieval · Computer Science 2022-04-05 Chao Chen , Dongsheng Li , Junchi Yan , Xiaokang Yang

Recent advances in Large Language Models (LLMs) have been changing the paradigm of Recommender Systems (RS). However, when items in the recommendation scenarios contain rich textual information, such as product descriptions in online…

Information Retrieval · Computer Science 2024-03-21 Zhi Zheng , Wenshuo Chao , Zhaopeng Qiu , Hengshu Zhu , Hui Xiong

Reinforcement Learning-based Recommender Systems (RLRS) have shown promise across a spectrum of applications, from e-commerce platforms to streaming services. Yet, they grapple with challenges, notably in crafting reward functions and…

Information Retrieval · Computer Science 2024-03-27 Siyu Wang , Xiaocong Chen , Lina Yao

Sequential recommendation (SR) aims to model user preferences by capturing behavior patterns from their item historical interaction data. Most existing methods model user preference in the time domain, omitting the fact that users'…

Information Retrieval · Computer Science 2023-05-09 Xinyu Du , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Guanfeng Liu , Yanchi Liu , Victor S. Sheng , Xiaofang Zhou

While Long Chain-of-Thought (Long CoT) reasoning has shown promise in Large Language Models (LLMs), its adoption for enhancing recommendation quality is growing rapidly. In this work, we critically examine this trend and argue that Long CoT…

Information Retrieval · Computer Science 2026-02-03 Hongxun Ding , Keqin Bao , Jizhi Zhang , Yi Fang , Wenxin Xu , Fuli Feng , Xiangnan He

Traditional recommender systems (RecSys) primarily infer user preferences from implicit signals (such as clicks, watches, and purchases), often neglecting the rich explicit contextual feedback users provide through verbal text, like…

Recommender systems play a crucial role in our daily lives. Feed streaming mechanism has been widely used in the recommender system, especially on the mobile Apps. The feed streaming setting provides users the interactive manner of…

Information Retrieval · Computer Science 2019-07-12 Lixin Zou , Long Xia , Zhuoye Ding , Jiaxing Song , Weidong Liu , Dawei Yin

Pretraining is a common technique in deep learning for increasing performance and reducing training time, with promising experimental results in deep reinforcement learning (RL). However, pretraining requires a relevant dataset for…

Machine Learning · Computer Science 2021-10-07 Saurav Kadavath , Samuel Paradis , Brian Yao

Sequential recommendation predicts users' next behaviors with their historical interactions. Recommending with longer sequences improves recommendation accuracy and increases the degree of personalization. As sequences get longer, existing…

Information Retrieval · Computer Science 2022-09-05 Qianying Lin , Wen-Ji Zhou , Yanshi Wang , Qing Da , Qing-Guo Chen , Bing Wang

Accounting for the fact that users have different sequential patterns, the main drawback of state-of-the-art recommendation strategies is that a fixed sequence length of user-item interactions is required as input to train the models. This…

Information Retrieval · Computer Science 2021-08-04 Stefanos Antaris , Dimitrios Rafailidis

Current advances in recommender systems have been remarkably successful in optimizing immediate engagement. However, long-term user engagement, a more desirable performance metric, remains difficult to improve. Meanwhile, recent…

Information Retrieval · Computer Science 2023-06-05 Wanqi Xue , Qingpeng Cai , Zhenghai Xue , Shuo Sun , Shuchang Liu , Dong Zheng , Peng Jiang , Kun Gai , Bo An

We analyze the unintended effects that recommender systems have on the preferences of users that they are learning. We consider a contextual multi-armed bandit recommendation algorithm that learns optimal product recommendations based on…

Machine Learning · Computer Science 2026-02-11 Prabhat Lankireddy , Jayakrishnan Nair , D Manjunath

Modeling the evolution of user preference is essential in recommender systems. Recently, dynamic graph-based methods have been studied and achieved SOTA for recommendation, majority of which focus on user's stable long-term preference.…

Information Retrieval · Computer Science 2022-08-02 Huixuan Chi , Hao Xu , Hao Fu , Mengya Liu , Mengdi Zhang , Yuji Yang , Qinfen Hao , Wei Wu

Behavior prediction based on historical behavioral data have practical real-world significance. It has been applied in recommendation, predicting academic performance, etc. With the refinement of user data description, the development of…

Machine Learning · Computer Science 2023-09-27 Haobing Liu , Yanmin Zhu , Chunyang Wang , Jianyu Ding , Jiadi Yu , Feilong Tang

The content that a recommender system (RS) shows to users influences them. Therefore, when choosing a recommender to deploy, one is implicitly also choosing to induce specific internal states in users. Even more, systems trained via…

Machine Learning · Computer Science 2022-08-15 Micah Carroll , Anca Dragan , Stuart Russell , Dylan Hadfield-Menell

Sequential recommender systems aim to predict a user's future interests by extracting temporal patterns from their behavioral history. Existing approaches typically employ transformer-based architectures to process long sequences of user…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar