English
Related papers

Related papers: Enhancing Transformers without Self-supervised Lea…

200 papers

Self-Attentive Sequential Recommendation (SASRec) effectively captures long-term user preferences by applying attention mechanisms to historical interactions. Concurrently, the rise of Large Language Models (LLMs) has motivated research…

Information Retrieval · Computer Science 2025-07-09 Kechen Liu

Sequential Recommendation characterizes the evolving patterns by modeling item sequences chronologically. The essential target of it is to capture the item transition correlations. The recent developments of transformer inspire the…

Information Retrieval · Computer Science 2021-05-04 Zhiwei Liu , Ziwei Fan , Yu Wang , Philip S. Yu

Transformer-based sequential recommenders, such as SASRec or BERT4Rec, typically rely solely on learned item ID embeddings, making them vulnerable to the item cold-start problem, particularly in environments with dynamic item catalogs.…

Information Retrieval · Computer Science 2025-08-27 Jan Malte Lichtenberg , Antonio De Candia , Matteo Ruffini

Recently, significant progress has been made in sequential recommendation with deep learning. Existing neural sequential recommendation models usually rely on the item prediction loss to learn model parameters or data representations.…

Information Retrieval · Computer Science 2020-08-19 Kun Zhou , Hui Wang , Wayne Xin Zhao , Yutao Zhu , Sirui Wang , Fuzheng Zhang , Zhongyuan Wang , Ji-Rong Wen

Sequential recommendation systems often struggle to make predictions or take action when dealing with cold-start items that have limited amount of interactions. In this work, we propose SimRec - a new approach to mitigate the cold-start…

Information Retrieval · Computer Science 2024-10-30 Shaked Brody , Shoval Lagziel

Since their introduction, Transformer-based models, such as SASRec and BERT4Rec, have become common baselines for sequential recommendations, surpassing earlier neural and non-neural methods. A number of following publications have shown…

Transformer based models are increasingly being used in various domains including recommender systems (RS). Pretrained transformer models such as BERT have shown good performance at language modelling. With the greater ability to model…

Information Retrieval · Computer Science 2025-01-03 Uzma Mushtaque

Sequential recommendation systems aim to provide personalized recommendations by analyzing dynamic preferences and dependencies within user behavior sequences. Recently, Transformer models can effectively capture user preferences. However,…

Information Retrieval · Computer Science 2024-07-30 Shun Zhang , Runsen Zhang , Zhirong Yang

Transformer models have achieved remarkable success in sequential recommender systems (SRSs). However, computing the attention matrix in traditional dot-product attention mechanisms results in a quadratic complexity with sequence lengths,…

Information Retrieval · Computer Science 2024-11-05 Langming Liu , Xiangyu Zhao , Chi Zhang , Jingtong Gao , Wanyu Wang , Wenqi Fan , Yiqi Wang , Ming He , Zitao Liu , Qing Li

Sequential recommender systems (SRS) have become the key technology in capturing user's dynamic interests and generating high-quality recommendations. Current state-of-the-art sequential recommender models are typically based on a…

Information Retrieval · Computer Science 2020-05-27 Yang Sun , Fajie Yuan , Min Yang , Guoao Wei , Zhou Zhao , Duo Liu

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald

Sequential recommendation (SR) models often capture user preferences based on the historically interacted item IDs, which usually obtain sub-optimal performance when the interaction history is limited. Content-based sequential…

Information Retrieval · Computer Science 2025-10-20 Donglin Zhou , Weike Pan , Zhong Ming

Although prevailing supervised and self-supervised learning augmented sequential recommendation (SeRec) models have achieved improved performance with powerful neural network architectures, we argue that they still suffer from two…

Information Retrieval · Computer Science 2025-02-14 Xinping Zhao , Baotian Hu , Yan Zhong , Shouzheng Huang , Zihao Zheng , Meng Wang , Haofen Wang , Min Zhang

Sequential Recommendation aims to predict the next item based on user behaviour. Recently, Self-Supervised Learning (SSL) has been proposed to improve recommendation performance. However, most of existing SSL methods use a uniform data…

Information Retrieval · Computer Science 2022-04-22 Yongjing Hao , Pengpeng Zhao , Xuefeng Xian , Guanfeng Liu , Deqing Wang , Lei Zhao , Yanchi Liu , Victor S. Sheng

Transformer structures have been widely used in sequential recommender systems (SRS). However, as user interaction histories increase, computational time and memory requirements also grow. This is mainly caused by the standard attention…

Information Retrieval · Computer Science 2026-05-25 Mengyang Ma , Xiaopeng Li , Wanyu Wang , Zhaocheng Du , Jingtong Gao , Pengyue Jia , Yuyang Ye , Yiqi Wang , Yunpeng Weng , Weihong Luo , Xiao Han , Xiangyu Zhao

Representation learning in sequential recommendation is critical for accurately modeling user interaction patterns and improving recommendation precision. However, existing approaches predominantly emphasize item-to-item transitions, often…

Information Retrieval · Computer Science 2024-07-17 Yang Liu , Yitong Wang , Chenyue Feng

There has been a growing interest in benchmarking sequential recommendation models and reproducing/improving existing models. For example, Rendle et al. improved matrix factorization models by tuning their parameters and hyperparameters.…

Information Retrieval · Computer Science 2023-05-23 Fangyu Li , Shenbao Yu , Feng Zeng , Fang Yang

Learning the user-item relevance hidden in implicit feedback data plays an important role in modern recommender systems. Neural sequential recommendation models, which formulates learning the user-item relevance as a sequential…

Information Retrieval · Computer Science 2022-03-01 Jingwei Zhuo , Bin Liu , Xiang Li , Han Zhu , Xiaoqiang Zhu

Sequential recommender systems have demonstrated strong capabilities in modeling users' dynamic preferences and capturing item transition patterns. However, real-world user behaviors are often noisy due to factors such as human errors,…

Information Retrieval · Computer Science 2026-04-13 Kaike Zhang , Qi Cao , Fei Sun , Xinran Liu , Huawei Shen , Xueqi Cheng

In the realm of music recommendation, sequential recommender systems have shown promise in capturing the dynamic nature of music consumption. Nevertheless, traditional Transformer-based models, such as SASRec and BERT4Rec, while effective,…

Information Retrieval · Computer Science 2024-09-09 Davide Abbattista , Vito Walter Anelli , Tommaso Di Noia , Craig Macdonald , Aleksandr Vladimirovich Petrov
‹ Prev 1 2 3 10 Next ›