English
Related papers

Related papers: Pay Attention to Attention for Sequential Recommen…

200 papers

Transformer-based sequential recommendation (SR) has been booming in recent years, with the self-attention mechanism as its key component. Self-attention has been widely believed to be able to effectively select those informative and…

Information Retrieval · Computer Science 2024-03-19 Peilin Zhou , Qichen Ye , Yueqi Xie , Jingqi Gao , Shoujin Wang , Jae Boum Kim , Chenyu You , Sunghun Kim

Sequential recommendation models have achieved state-of-the-art performance using self-attention mechanism. It has since been found that moving beyond only using item ID and positional embeddings leads to a significant accuracy boost when…

Information Retrieval · Computer Science 2024-09-10 Linsey Pang , Amir Hossein Raffiee , Wei Liu , Keld Lundgaard

In this paper, we propose a novel sequence-aware recommendation model. Our model utilizes self-attention mechanism to infer the item-item relationship from user's historical interactions. With self-attention, it is able to estimate the…

Information Retrieval · Computer Science 2018-08-28 Shuai Zhang , Yi Tay , Lina Yao , Aixin Sun

Sequential Recommendation (SR) focuses on personalizing user experiences by predicting future preferences based on historical interactions. Transformer models, with their attention mechanisms, have become the dominant architecture in SR…

Information Retrieval · Computer Science 2025-08-05 Yuli Liu , Wenjun Kong , Cheng Luo , Weizhi Ma

Sequential Recommendation (SR) models user dynamics and predicts the next preferred items based on the user history. Existing SR methods model the 'was interacted before' item-item transitions observed in sequences, which can be viewed as…

Information Retrieval · Computer Science 2022-11-01 Ziwei Fan , Zhiwei Liu , Chen Wang , Peijie Huang , Hao Peng , Philip S. Yu

Sequential recommendation aims to recommend the next item of users' interest based on their historical interactions. Recently, the self-attention mechanism has been adapted for sequential recommendation, and demonstrated state-of-the-art…

Information Retrieval · Computer Science 2022-09-19 Bo Peng , Srinivasan Parthasarathy , Xia Ning

Attribute-aware sequential recommendation entails predicting the next item a user will interact with based on a chronologically ordered history of past interactions, enriched with item attributes. Existing methods typically leverage…

Information Retrieval · Computer Science 2026-05-08 Shereen Elsayed , Ngoc Son Le , Ahmed Rashed , Lars Schmidt-Thieme

A new approach called ABRF (the attention-based random forest) and its modifications for applying the attention mechanism to the random forest (RF) for regression and classification are proposed. The main idea behind the proposed ABRF…

Machine Learning · Computer Science 2022-01-11 Lev V. Utkin , Andrei V. Konstantinov

Recent studies identified that sequential Recommendation is improved by the attention mechanism. By following this development, we propose Relation-Aware Kernelized Self-Attention (RKSA) adopting a self-attention mechanism of the…

Machine Learning · Computer Science 2019-11-18 Mingi Ji , Weonyoung Joo , Kyungwoo Song , Yoon-Yeong Kim , Il-Chul Moon

Sequential Recommendation is a prominent topic in current research, which uses user behavior sequence as an input to predict future behavior. By assessing the correlation strength of historical behavior through the dot product, the model…

Information Retrieval · Computer Science 2023-02-23 Jiayi Chen , Wen Wu , Liye Shi , Yu Ji , Wenxin Hu , Xi Chen , Wei Zheng , Liang He

Transformer based models are increasingly being used in various domains including recommender systems (RS). Pretrained transformer models such as BERT have shown good performance at language modelling. With the greater ability to model…

Information Retrieval · Computer Science 2025-01-03 Uzma Mushtaque

Users prefer diverse recommendations over homogeneous ones. However, most previous work on Sequential Recommenders does not consider diversity, and strives for maximum accuracy, resulting in homogeneous recommendations. In this paper, we…

Information Retrieval · Computer Science 2020-08-04 Anton Steenvoorden , Emanuele Di Gloria , Wanyu Chen , Pengjie Ren , Maarten de Rijke

In-context learning with attention enables large neural networks to make context-specific predictions by selectively focusing on relevant examples. Here, we adapt this idea to supervised learning procedures such as lasso regression and…

Machine Learning · Statistics 2025-12-11 Erin Craig , Robert Tibshirani

Sequential recommendation (SR) is to accurately recommend a list of items for a user based on her current accessed ones. While new-coming users continuously arrive in the real world, one crucial task is to have inductive SR that can produce…

Information Retrieval · Computer Science 2021-02-01 Cheng Hsu , Cheng-Te Li

Sequential recommendation models the dynamics of a user's previous behaviors in order to forecast the next item, and has drawn a lot of attention. Transformer-based approaches, which embed items as vectors and use dot-product self-attention…

Information Retrieval · Computer Science 2022-03-08 Ziwei Fan , Zhiwei Liu , Alice Wang , Zahra Nazari , Lei Zheng , Hao Peng , Philip S. Yu

Convolutional neural networks have allowed remarkable advances in single image super-resolution (SISR) over the last decade. Among recent advances in SISR, attention mechanisms are crucial for high-performance SR models. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Haoyu Chen , Jinjin Gu , Zhi Zhang

Sequential recommendation (SR) aims to model users dynamic preferences from a series of interactions. A pivotal challenge in user modeling for SR lies in the inherent variability of user preferences. An effective SR model is expected to…

Information Retrieval · Computer Science 2023-08-14 Juyong Jiang , Peiyan Zhang , Yingtao Luo , Chaozhuo Li , Jae Boum Kim , Kai Zhang , Senzhang Wang , Xing Xie , Sunghun Kim

Transformer models are computationally costly on long sequences since regular attention has quadratic $O(n^2)$ time complexity. We introduce Wavelet-Enhanced Random Spectral Attention (WERSA), a novel mechanism of linear $O(n)$ time…

Machine Learning · Computer Science 2025-07-14 Vincenzo Dentamaro

Sequential recommendation is a popular paradigm in modern recommender systems. In particular, one challenging problem in this space is cross-domain sequential recommendation (CDSR), which aims to predict future behaviors given user…

Information Retrieval · Computer Science 2025-05-29 Clark Mingxuan Ju , Leonardo Neves , Bhuvesh Kumar , Liam Collins , Tong Zhao , Yuwei Qiu , Qing Dou , Sohail Nizam , Sen Yang , Neil Shah

Social recommendation system is to predict unobserved user-item rating values by taking advantage of user-user social relation and user-item ratings. However, user/item diversities in social recommendations are not well utilized in the…

Artificial Intelligence · Computer Science 2020-11-17 Dongsheng Luo , Yuchen Bian , Xiang Zhang , Jun Huan
‹ Prev 1 2 3 10 Next ›