English
Related papers

Related papers: Scaling Sequential Recommendation Models with Tran…

200 papers

Sequential recommender systems have recently achieved significant performance improvements with the exploitation of deep learning (DL) based methods. However, although various DL-based methods have been introduced, most of them only focus…

Information Retrieval · Computer Science 2022-03-29 Joo-yeong Song , Bongwon Suh

Modern sequential recommender systems commonly use transformer-based models for next-item prediction. While these models demonstrate a strong balance between efficiency and quality, integrating interleaving features - such as the query…

Information Retrieval · Computer Science 2025-08-13 Andrii Dzhoha , Alisa Mironenko , Evgeny Labzin , Vladimir Vlasov , Maarten Versteegh , Marjan Celikik

Practical recommender systems need be periodically retrained to refresh the model with new interaction data. To pursue high model fidelity, it is usually desirable to retrain the model on both historical and new data, since it can account…

Information Retrieval · Computer Science 2021-01-15 Yang Zhang , Fuli Feng , Chenxu Wang , Xiangnan He , Meng Wang , Yan Li , Yongdong Zhang

Session-based recommendation is the task of predicting the next item a user will interact with, often without access to historical user data. In this work, we introduce Sequential Masked Modeling, a novel approach for encoder-only…

Information Retrieval · Computer Science 2024-10-16 Anis Redjdal , Luis Pinto , Michel Desmarais

Neural scaling laws define a predictable relationship between a model's parameter count and its performance after training in the form of a power law. However, most research to date has not explicitly investigated whether scaling laws can…

Computation and Language · Computer Science 2022-10-19 Maor Ivgi , Yair Carmon , Jonathan Berant

Real-time personalization has advanced significantly in recent years, with platforms utilizing machine learning models to predict user preferences based on rich behavioral data on each individual user. Traditional approaches usually rely on…

Optimization and Control · Mathematics 2025-10-14 Lin An , Andrew A. Li , Vaisnavi Nemala , Gabriel Visotsky

Large Language Models (LLMs) represent a promising frontier for recommender systems, yet their development has been impeded by the absence of predictable scaling laws, which are crucial for guiding research and optimizing resource…

Information Retrieval · Computer Science 2026-02-16 Benyu Zhang , Qiang Zhang , Jianpeng Cheng , Hong-You Chen , Qifei Wang , Wei Sun , Shen Li , Jia Li , Jiahao Wu , Xiangjun Fan , Hong Yan

Sequential recommendation aims to model dynamic user behavior from historical interactions. Existing methods rely on either explicit item IDs or general textual features for sequence modeling to understand user preferences. While promising,…

Information Retrieval · Computer Science 2023-05-30 Jiacheng Li , Ming Wang , Jin Li , Jinmiao Fu , Xin Shen , Jingbo Shang , Julian McAuley

Sequential recommender systems (SRSs) aim to predict the subsequent items which may interest users via comprehensively modeling users' complex preference embedded in the sequence of user-item interactions. However, most of existing SRSs…

Information Retrieval · Computer Science 2024-10-31 Chengkai Huang , Shoujin Wang , Xianzhi Wang , Lina Yao

Sequential recommendation requires the recommender to capture the evolving behavior characteristics from logged user behavior data for accurate recommendations. However, user behavior sequences are viewed as a script with multiple ongoing…

Information Retrieval · Computer Science 2022-06-15 Zhiyu Yao , Xinyang Chen , Sinan Wang , Qinyan Dai , Yumeng Li , Tanchao Zhu , Mingsheng Long

Today's robots are increasingly interacting with people and need to efficiently learn inexperienced user's preferences. A common framework is to iteratively query the user about which of two presented robot trajectories they prefer. While…

Robotics · Computer Science 2021-10-04 Nils Wilde , Erdem Bıyık , Dorsa Sadigh , Stephen L. Smith

Ranking is a core task in recommender systems, which aims at providing an ordered list of items to users. Typically, a ranking function is learned from the labeled dataset to optimize the global performance, which produces a ranking score…

Information Retrieval · Computer Science 2019-07-24 Changhua Pei , Yi Zhang , Yongfeng Zhang , Fei Sun , Xiao Lin , Hanxiao Sun , Jian Wu , Peng Jiang , Wenwu Ou

The goal of recommender systems is to provide ordered item lists to users that best match their interests. As a critical task in the recommendation pipeline, re-ranking has received increasing attention in recent years. In contrast to…

Information Retrieval · Computer Science 2022-03-24 Yi Li , Jieming Zhu , Weiwen Liu , Liangcai Su , Guohao Cai , Qi Zhang , Ruiming Tang , Xi Xiao , Xiuqiang He

Recommender systems often face heterogeneous datasets containing highly personalized historical data of users, where no single model could give the best recommendation for every user. We observe this ubiquitous phenomenon on both public and…

Information Retrieval · Computer Science 2020-05-06 Mi Luo , Fei Chen , Pengxiang Cheng , Zhenhua Dong , Xiuqiang He , Jiashi Feng , Zhenguo Li

A fundamental challenge for sequential recommenders is to capture the sequential patterns of users toward modeling how users transit among items. In many practical scenarios, however, there are a great number of cold-start users with only…

Information Retrieval · Computer Science 2021-07-15 Jianling Wang , Kaize Ding , James Caverlee

Sequential recommender systems aim to predict a user's future interests by extracting temporal patterns from their behavioral history. Existing approaches typically employ transformer-based architectures to process long sequences of user…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Recommendation systems must continuously adapt to evolving user behavior, yet the volume of data generated in large-scale streaming environments makes frequent full retraining impractical. This work investigates how targeted data selection…

Motivated by scaling laws in language modeling that demonstrate how test loss scales as a power law with model and dataset sizes, we find that similar laws exist in preference modeling. We propose World Preference Modeling$ (WorldPM) to…

Recommender systems are indispensable in the realm of online applications, and sequential recommendation has enjoyed considerable prevalence due to its capacity to encapsulate the dynamic shifts in user interests. However, previous…

Information Retrieval · Computer Science 2024-04-16 Junzhe Jiang , Shang Qu , Mingyue Cheng , Qi Liu , Zhiding Liu , Hao Zhang , Rujiao Zhang , Kai Zhang , Rui Li , Jiatong Li , Min Gao

Capturing the dynamics in user preference is crucial to better predict user future behaviors because user preferences often drift over time. Many existing recommendation algorithms -- including both shallow and deep ones -- often model such…

Information Retrieval · Computer Science 2022-04-05 Chao Chen , Dongsheng Li , Junchi Yan , Xiaokang Yang