English
Related papers

Related papers: Linear Recurrent Units for Sequential Recommendati…

200 papers

Most existing contrastive learning-based sequential recommendation (SR) methods rely on random operations (e.g., crop, reorder, and substitute) to generate augmented sequences. These methods often struggle to create positive sample pairs…

Information Retrieval · Computer Science 2025-03-27 Wei Wang , Yujie Lin , Jianli Zhao , Moyan Zhang , Pengjie Ren , Xianye Ben , Yujun Li

Linear recurrent neural networks, such as State Space Models (SSMs) and Linear Recurrent Units (LRUs), have recently shown state-of-the-art performance on long sequence modelling benchmarks. Despite their success, their empirical…

Machine Learning · Computer Science 2024-10-08 Kai Biegun , Rares Dolga , Jake Cunningham , David Barber

Modeling long sequences of user behaviors has emerged as a critical frontier in generative recommendation. However, existing solutions face a dilemma: linear attention mechanisms achieve efficiency at the cost of retrieval precision due to…

Information Retrieval · Computer Science 2026-02-23 Lei Xin , Yuhao Zheng , Ke Cheng , Changjiang Jiang , Zifan Zhang , Fanhu Zeng

Sequential Recommendation is a prominent topic in current research, which uses user behavior sequence as an input to predict future behavior. By assessing the correlation strength of historical behavior through the dot product, the model…

Information Retrieval · Computer Science 2023-02-23 Jiayi Chen , Wen Wu , Liye Shi , Yu Ji , Wenxin Hu , Xi Chen , Wei Zheng , Liang He

User interests are usually dynamic in the real world, which poses both theoretical and practical challenges for learning accurate preferences from rich behavior data. Among existing user behavior modeling solutions, attention networks are…

Information Retrieval · Computer Science 2022-04-14 Chao Chen , Haoyu Geng , Nianzu Yang , Junchi Yan , Daiyue Xue , Jianping Yu , Xiaokang Yang

Recurrent Neural Networks (RNN) are known as powerful models for handling sequential data, and especially widely utilized in various natural language processing tasks. In this paper, we propose Contextual Recurrent Units (CRU) for enhancing…

Computation and Language · Computer Science 2019-11-15 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhipeng Chen , Shijin Wang , Guoping Hu

Sequential recommendation (SR) models often capture user preferences based on the historically interacted item IDs, which usually obtain sub-optimal performance when the interaction history is limited. Content-based sequential…

Information Retrieval · Computer Science 2025-10-20 Donglin Zhou , Weike Pan , Zhong Ming

State-of-the-art sequential recommendation models heavily rely on transformer's attention mechanism. However, the quadratic computational and memory complexities of self attention have limited its scalability for modeling users' long range…

Artificial Intelligence · Computer Science 2025-02-13 Jiaxin Deng , Shiyao Wang , Song Lu , Yinfeng Li , Xinchen Luo , Yuanjun Liu , Peixing Xu , Guorui Zhou

Sequential recommendation (SR) models predict a user's next interaction by modeling their historical behaviors. Transformer-based SR methods, notably BERT4Rec, effectively capture these patterns but incur significant computational overhead…

Information Retrieval · Computer Science 2026-02-09 Shankar Veludandi , Gulrukh Kurdistan , Uzma Mushtaque

Sequential recommendation involves automatically recommending the next item to users based on their historical item sequence. While most prior research employs RNN or transformer methods to glean information from the item…

Information Retrieval · Computer Science 2024-10-10 Xiaofan Zhou

Recurrent neural networks (RNNs) have been used extensively and with increasing success to model various types of sequential data. Much of this progress has been achieved through devising recurrent units and architectures with the…

Machine Learning · Statistics 2017-03-06 Yacine Jernite , Edouard Grave , Armand Joulin , Tomas Mikolov

Existing sequential recommendation models, even advanced diffusion-based approaches, often struggle to capture the rich semantic intent underlying user behavior, especially for new users or long-tail items. This limitation stems from their…

Information Retrieval · Computer Science 2026-01-08 Bo-Chian Chen , Manel Slokom

Recently, significant progress has been made in sequential recommendation with deep learning. Existing neural sequential recommendation models usually rely on the item prediction loss to learn model parameters or data representations.…

Information Retrieval · Computer Science 2020-08-19 Kun Zhou , Hui Wang , Wayne Xin Zhao , Yutao Zhu , Sirui Wang , Fuzheng Zhang , Zhongyuan Wang , Ji-Rong Wen

In Sequential Recommendation Systems (SRSs), Transformer models have demonstrated remarkable performance but face computational and memory cost challenges, especially when modeling long-term user behavior sequences. Due to its quadratic…

Information Retrieval · Computer Science 2026-03-25 Juntao Hu , Wei Zhou , Haini Cai , Xiao Du , Huayi Shen , Junhao Wen

The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec arises from the open-world knowledge and reasoning capabilities…

Information Retrieval · Computer Science 2024-07-02 Hangyu Wang , Jianghao Lin , Bo Chen , Yang Yang , Ruiming Tang , Weinan Zhang , Yong Yu

Sequential Recommendation (SR) task involves predicting the next item a user is likely to interact with, given their past interactions. The SR models examine the sequence of a user's actions to discern more complex behavioral patterns and…

Information Retrieval · Computer Science 2025-04-22 Wujiang Xu , Qitian Wu , Zujie Liang , Jiaojiao Han , Xuying Ning , Yunxiao Shi , Wenfang Lin , Yongfeng Zhang

Generative recommendation (GenRec) models typically model user behavior via full attention, but scaling to lifelong sequences is hindered by prohibitive computational costs and noise accumulation from stochastic interactions. To address…

Information Retrieval · Computer Science 2026-02-16 Yixiao Chen , Yuan Wang , Yue Liu , Qiyao Wang , Ke Cheng , Xin Xu , Juntong Yan , Shuojin Yang , Menghao Guo , Jun Zhang , Huan Yu , Jie Jiang

Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical interactions. Despite their success, we argue that these approaches…

Information Retrieval · Computer Science 2021-03-02 Xu Xie , Fei Sun , Zhaoyang Liu , Shiwen Wu , Jinyang Gao , Bolin Ding , Bin Cui

We introduce a new sequential transformer reinforcement learning architecture RLT4Rec and demonstrate that it achieves excellent performance in a range of item recommendation tasks. RLT4Rec uses a relatively simple transformer architecture…

Information Retrieval · Computer Science 2024-12-11 Dilina Chandika Rajapakse , Douglas Leith

Characterizing users' interests accurately plays a significant role in an effective recommender system. The sequential recommender system can learn powerful hidden representations of users from successive user-item interactions and dynamic…

Social and Information Networks · Computer Science 2020-11-24 Lingxiao Zhang , Jiangpeng Yan , Yujiu Yang , Xiu Li