English
Related papers

Related papers: Self-Attentive Sequential Recommendation

200 papers

Sequential recommendation tasks, which aim to predict the next item a user will interact with, typically rely on models trained solely on historical data. However, in real-world scenarios, user behavior can fluctuate in the long interaction…

Information Retrieval · Computer Science 2024-10-01 Zhaoqi Yang , Yanan Wang , Yong Ge

Recurrent neural networks (RNNs) have shown the ability to improve scene parsing through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various long-range semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Heng Fan , Peng Chu , Longin Jan Latecki , Haibin Ling

Sentence matching is widely used in various natural language tasks such as natural language inference, paraphrase identification, and question answering. For these tasks, understanding logical and semantic relationship between two sentences…

Computation and Language · Computer Science 2018-11-05 Seonhoon Kim , Inho Kang , Nojun Kwak

Recent studies identified that sequential Recommendation is improved by the attention mechanism. By following this development, we propose Relation-Aware Kernelized Self-Attention (RKSA) adopting a self-attention mechanism of the…

Machine Learning · Computer Science 2019-11-18 Mingi Ji , Weonyoung Joo , Kyungwoo Song , Yoon-Yeong Kim , Il-Chul Moon

Graph Neural Networks (GNN) have shown remarkable performance in different tasks. However, there are a few studies about GNN on recommender systems. GCN as a type of GNNs can extract high-quality embeddings for different entities in a…

Information Retrieval · Computer Science 2022-01-17 Taher Hekmatfar , Saman Haratizadeh , Parsa Razban , Sama Goliaei

Recently, significant progress has been made in sequential recommendation with deep learning. Existing neural sequential recommendation models usually rely on the item prediction loss to learn model parameters or data representations.…

Information Retrieval · Computer Science 2020-08-19 Kun Zhou , Hui Wang , Wayne Xin Zhao , Yutao Zhu , Sirui Wang , Fuzheng Zhang , Zhongyuan Wang , Ji-Rong Wen

RNNs have been shown to be excellent models for sequential data and in particular for data that is generated by users in an session-based manner. The use of RNNs provides impressive performance benefits over classical methods in…

Machine Learning · Computer Science 2018-08-29 Balázs Hidasi , Alexandros Karatzoglou

Sequential recommendation is a fundamental task for network applications, and it usually suffers from the item cold start problem due to the insufficiency of user feedbacks. There are currently three kinds of popular approaches which are…

Information Retrieval · Computer Science 2018-11-21 Qiang Cui , Shu Wu , Qiang Liu , Wen Zhong , Liang Wang

We apply recurrent neural networks (RNN) on a new domain, namely recommender systems. Real-life recommender systems often face the problem of having to base recommendations only on short session-based data (e.g. a small sportsware website)…

Machine Learning · Computer Science 2016-03-30 Balázs Hidasi , Alexandros Karatzoglou , Linas Baltrunas , Domonkos Tikk

A central aim in computational neuroscience is to relate the activity of large populations of neurons to an underlying dynamical system. Models of these neural dynamics should ideally be both interpretable and fit the observed data well.…

Machine Learning · Computer Science 2025-02-27 Matthijs Pals , A Erdem Sağtekin , Felix Pei , Manuel Gloeckler , Jakob H Macke

The self-attention mechanism, which equips with a strong capability of modeling long-range dependencies, is one of the extensively used techniques in the sequential recommendation field. However, many recent studies represent that current…

Information Retrieval · Computer Science 2023-05-18 Xinyu Du , Huanhuan Yuan , Pengpeng Zhao , Jianfeng Qu , Fuzhen Zhuang , Guanfeng Liu , Victor S. Sheng

Modeling long sequences of user behaviors has emerged as a critical frontier in generative recommendation. However, existing solutions face a dilemma: linear attention mechanisms achieve efficiency at the cost of retrieval precision due to…

Information Retrieval · Computer Science 2026-02-23 Lei Xin , Yuhao Zheng , Ke Cheng , Changjiang Jiang , Zifan Zhang , Fanhu Zeng

Sequential recommender systems (SRS) could capture dynamic user preferences by modeling historical behaviors ordered in time. Despite effectiveness, focusing only on the \textit{collaborative signals} from behaviors does not fully grasp…

Information Retrieval · Computer Science 2024-09-20 Mingyue Cheng , Hao Zhang , Qi Liu , Fajie Yuan , Zhi Li , Zhenya Huang , Enhong Chen , Jun Zhou , Longfei Li

Traditional sequential recommendation methods assume that users' sequence data is clean enough to learn accurate sequence representations to reflect user preferences. In practice, users' sequences inevitably contain noise (e.g., accidental…

Information Retrieval · Computer Science 2024-03-08 Chi Zhang , Qilong Han , Rui Chen , Xiangyu Zhao , Peng Tang , Hongtao Song

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Transformers have been established as the de-facto backbones for most recent advances in sequence modeling, mainly due to their growing memory capacity that scales with the context length. While plausible for retrieval tasks, it causes…

Machine Learning · Computer Science 2026-03-02 Ali Behrouz , Zeman Li , Yuan Deng , Peilin Zhong , Meisam Razaviyayn , Vahab Mirrokni

Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components,…

Machine Learning · Computer Science 2018-10-10 Ming Zeng , Haoxiang Gao , Tong Yu , Ole J. Mengshoel , Helge Langseth , Ian Lane , Xiaobing Liu

Reciprocal recommender system (RRS), considering a two-way matching between two parties, has been widely applied in online platforms like online dating and recruitment. Existing RRS models mainly capture static user preferences, which have…

Information Retrieval · Computer Science 2023-06-27 Bowen Zheng , Yupeng Hou , Wayne Xin Zhao , Yang Song , Hengshu Zhu

The key challenge of sequence representation learning is to capture the long-range temporal dependencies. Typical methods for supervised sequence representation learning are built upon recurrent neural networks to capture temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Wenjie Pei , Xin Feng , Canmiao Fu , Qiong Cao , Guangming Lu , Yu-Wing Tai

Artificial Recurrent Neural Networks (RNNs) are widely used in neuroscience to model the collective activity of neurons during behavioral tasks. The high dimensionality of their parameter and activity spaces, however, often make it…

Dynamical Systems · Mathematics 2025-10-16 Alice Marraffa , Renate Krause , Valerio Mante , George Haller