English
Related papers

Related papers: Next Item Recommendation with Self-Attention

200 papers

Recently, textual information has been proved to play a positive role in recommendation systems. However, most of the existing methods only focus on representation learning of textual information in ratings, while potential selection bias…

Information Retrieval · Computer Science 2021-10-14 Jiabin Liu , Zheng Wei , Zhengpin Li , Xiaojun Mao , Jian Wang , Zhongyu Wei , Qi Zhang

Recently, relational metric learning methods have been received great attention in recommendation community, which is inspired by the translation mechanism in knowledge graph. Different from the knowledge graph where the entity-to-entity…

Information Retrieval · Computer Science 2024-06-18 Mingming Li , Fuqing Zhu , Feng Yuan , Songlin Hu

The inherent instability and noise in user interaction data challenge sequential recommendation systems. Prevailing masked attention models, relying on a single query from the most recent item, are sensitive to this noise, reducing…

Information Retrieval · Computer Science 2025-09-30 Mingshi Xu , Haoren Zhu , Wilfred Siu Hung Ng

Modeling user-item interaction patterns is an important task for personalized recommendations. Many recommender systems are based on the assumption that there exists a linear relationship between users and items while neglecting the…

Information Retrieval · Computer Science 2018-07-12 Shuai Zhang , Lina Yao , Aixin Sun , Sen Wang , Guodong Long , Manqing Dong

Sequential recommendations aim to capture users' preferences from their historical interactions so as to predict the next item that they will interact with. Sequential recommendation methods usually assume that all items in a user's…

Information Retrieval · Computer Science 2023-04-24 Yujie Lin , Chenyang Wang , Zhumin Chen , Zhaochun Ren , Xin Xin , Qiang Yan , Maarten de Rijke , Xiuzhen Cheng , Pengjie Ren

Modeling user interests is crucial in real-world recommender systems. In this paper, we present a new user interest representation model for personalized recommendation. Specifically, the key novelty behind our model is that it explicitly…

Information Retrieval · Computer Science 2020-11-12 Shuai Zhang , Huoyu Liu , Aston Zhang , Yue Hu , Ce Zhang , Yumeng Li , Tanchao Zhu , Shaojian He , Wenwu Ou

Sequential recommendation tasks, which aim to predict the next item a user will interact with, typically rely on models trained solely on historical data. However, in real-world scenarios, user behavior can fluctuate in the long interaction…

Information Retrieval · Computer Science 2024-10-01 Zhaoqi Yang , Yanan Wang , Yong Ge

In this paper we propose a neural network model with a novel Sequential Attention layer that extends soft attention by assigning weights to words in an input sequence in a way that takes into account not just how well that word matches a…

Computation and Language · Computer Science 2017-06-28 Sebastian Brarda , Philip Yeres , Samuel R. Bowman

We present an attention-based modular neural framework for computer vision. The framework uses a soft attention mechanism allowing models to be trained with gradient descent. It consists of three modules: a recurrent attention module…

Machine Learning · Computer Science 2016-04-29 Samira Ebrahimi Kahou , Vincent Michalski , Roland Memisevic

In the Transformer model, "self-attention" combines information from attended embeddings into the representation of the focal embedding in the next layer. Thus, across layers of the Transformer, information originating from different tokens…

Machine Learning · Computer Science 2020-06-02 Samira Abnar , Willem Zuidema

Large Language Models (LLMs) have recently gained increasing attention in the field of recommendation. Existing LLM-based methods typically represent items as token sequences, and apply attention layers on these tokens to generate…

Information Retrieval · Computer Science 2026-04-15 Xiaokun Zhang , Bowei He , Jiamin Chen , Ziqiang Cui , Chen Ma

Sequential recommendation demonstrates the capability to recommend items by modeling the sequential behavior of users. Traditional methods typically treat users as sequences of items, overlooking the collaborative relationships among them.…

Information Retrieval · Computer Science 2023-08-15 Sijia Liu , Jiahao Liu , Hansu Gu , Dongsheng Li , Tun Lu , Peng Zhang , Ning Gu

Modeling user sequential behaviors has recently attracted increasing attention in the recommendation domain. Existing methods mostly assume coherent preference in the same sequence. However, user personalities are volatile and easily…

Information Retrieval · Computer Science 2022-04-01 Weiqi Shao , Xu Chen , Long Xia , Jiashu Zhao , Dawei Yin

Sequential recommender models are essential components of modern industrial recommender systems. These models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform. Most…

Information Retrieval · Computer Science 2023-03-28 Bo Chang , Alexandros Karatzoglou , Yuyan Wang , Can Xu , Ed H. Chi , Minmin Chen

Factorization methods for recommender systems tend to represent users as a single latent vector. However, user behavior and interests may change in the context of the recommendations that are presented to the user. For example, in the case…

Information Retrieval · Computer Science 2020-04-21 Oren Barkan , Avi Caciularu , Ori Katz , Noam Koenigstein

In the era of advancing information technology, recommender systems have emerged as crucial tools for dealing with information overload. However, traditional recommender systems still have limitations in capturing the dynamic evolution of…

Information Retrieval · Computer Science 2025-04-09 Mingjian Fu , Hengsheng Chen , Dongchun Jiang , Yanchao Tan

Sequential dynamics are a key feature of many modern recommender systems, which seek to capture the `context' of users' activities on the basis of actions they have performed recently. To capture such patterns, two approaches have…

Information Retrieval · Computer Science 2018-08-30 Wang-Cheng Kang , Julian McAuley

The success of recommender systems in modern online platforms is inseparable from the accurate capture of users' personal tastes. In everyday life, large amounts of user feedback data are created along with user-item online interactions in…

Machine Learning · Computer Science 2019-06-25 Xiao Zhou , Danyang Liu , Jianxun Lian , Xing Xie

Probabilistic models can learn users' preferences from the history of their item adoptions on a social media site, and in turn, recommend new items to users based on learned preferences. However, current models ignore psychological factors…

Information Retrieval · Computer Science 2013-11-07 Jeon-Hyung Kang , Kristina Lerman

Attributes, such as metadata and profile, carry useful information which in principle can help improve accuracy in recommender systems. However, existing approaches have difficulty in fully leveraging attribute information due to practical…

Information Retrieval · Computer Science 2018-05-31 Kuan Liu , Xing Shi , Prem Natarajan