English
Related papers

Related papers: Next Item Recommendation with Self-Attention

200 papers

Transformer-based sequential recommenders are very powerful for capturing both short-term and long-term sequential item dependencies. This is mainly attributed to their unique self-attention networks to exploit pairwise item-item…

Information Retrieval · Computer Science 2022-12-09 Huiyuan Chen , Yusan Lin , Menghai Pan , Lan Wang , Chin-Chia Michael Yeh , Xiaoting Li , Yan Zheng , Fei Wang , Hao Yang

Sequential recommender systems aim to model users' evolving interests from their historical behaviors, and hence make customized time-relevant recommendations. Compared with traditional models, deep learning approaches such as CNN and RNN…

Information Retrieval · Computer Science 2021-03-08 Chang Liu , Xiaoguang Li , Guohao Cai , Zhenhua Dong , Hong Zhu , Lifeng Shang

Deep neural networks (DNNs) have been widely employed in recommender systems including incorporating attention mechanism for performance improvement. However, most of existing attention-based models only apply item-level attention on user…

Information Retrieval · Computer Science 2020-06-20 Deqing Yang , Zengcun Song , Lvxin Xue , Yanghua Xiao

Session-based recommendation (SR) has become an important and popular component of various e-commerce platforms, which aims to predict the next interacted item based on a given session. Most of existing SR models only focus on exploiting…

Information Retrieval · Computer Science 2020-06-19 Wenjing Meng , Deqing Yang , Yanghua Xiao

Learning to rank is a key component of many e-commerce search engines. In learning to rank, one is interested in optimising the global ordering of a list of items according to their utility for users.Popular approaches learn a scoring…

Information Retrieval · Computer Science 2021-05-25 Przemysław Pobrotyn , Tomasz Bartczak , Mikołaj Synowiec , Radosław Białobrzeski , Jarosław Bojar

The great success of Transformer-based models benefits from the powerful multi-head self-attention mechanism, which learns token dependencies and encodes contextual information from the input. Prior work strives to attribute model decisions…

Computation and Language · Computer Science 2021-02-26 Yaru Hao , Li Dong , Furu Wei , Ke Xu

In this paper we develop a novel recommendation model that explicitly incorporates time information. The model relies on an embedding layer and TSL attention-like mechanism with inner products in different vector spaces, that can be thought…

Using a sequence-to-sequence framework, many neural conversation models for chit-chat succeed in naturalness of the response. Nevertheless, the neural conversation models tend to give generic responses which are not specific to given…

Computation and Language · Computer Science 2018-05-24 Jonggu Kim , Doyeon Kong , Jong-Hyeok Lee

Recommender systems aim to provide personalized item recommendations by capturing user behaviors derived from their interaction history. Considering that user interactions naturally occur sequentially based on users' intents in mind, user…

Information Retrieval · Computer Science 2025-01-14 Yijin Choi , Chiehyeon Lim

A large number of empirical studies on applying self-attention models in the domain of recommender systems are based on offline evaluation and metrics computed on standardized datasets, without insights on how these models perform in real…

Information Retrieval · Computer Science 2022-11-30 Marjan Celikik , Jacek Wasilewski , Sahar Mbarek , Pablo Celayes , Pierre Gagliardi , Duy Pham , Nour Karessli , Ana Peleteiro Ramallo

Sequential recommendation systems model dynamic preferences of users based on their historical interactions with platforms. Despite recent progress, modeling short-term and long-term behavior of users in such systems is nontrivial and…

Information Retrieval · Computer Science 2021-07-07 Mehrnaz Amjadi , Seyed Danial Mohseni Taheri , Theja Tulabandhula

Ranking is a central task in machine learning and information retrieval. In this task, it is especially important to present the user with a slate of items that is appealing as a whole. This in turn requires taking into account interactions…

Information Retrieval · Computer Science 2019-03-21 Irwan Bello , Sayali Kulkarni , Sagar Jain , Craig Boutilier , Ed Chi , Elad Eban , Xiyang Luo , Alan Mackey , Ofer Meshi

Recently, deep neural networks are widely applied in recommender systems for their effectiveness in capturing/modeling users' preferences. Especially, the attention mechanism in deep learning enables recommender systems to incorporate…

Information Retrieval · Computer Science 2021-03-17 Jianqing Zhang , Dongjing Wang , Dongjin Yu

Human Activity Recognition from body-worn sensor data poses an inherent challenge in capturing spatial and temporal dependencies of time-series signals. In this regard, the existing recurrent or convolutional or their hybrid models for…

Recent methods in sequential recommendation focus on learning an overall embedding vector from a user's behavior sequence for the next-item recommendation. However, from empirical analysis, we discovered that a user's behavior sequence…

Information Retrieval · Computer Science 2021-02-19 Qiaoyu Tan , Jianwei Zhang , Jiangchao Yao , Ninghao Liu , Jingren Zhou , Hongxia Yang , Xia Hu

Self-attention model have shown its flexibility in parallel computation and the effectiveness on modeling both long- and short-term dependencies. However, it calculates the dependencies between representations without considering the…

Computation and Language · Computer Science 2019-02-18 Baosong Yang , Jian Li , Derek Wong , Lidia S. Chao , Xing Wang , Zhaopeng Tu

Recommender Systems have proliferated as general-purpose approaches to model a wide variety of consumer interaction data. Specific instances make use of signals ranging from user feedback, item relationships, geographic locality, social…

Information Retrieval · Computer Science 2018-08-31 Wang-Cheng Kang , Mengting Wan , Julian McAuley

Local features at neighboring spatial positions in feature maps have high correlation since their receptive fields are often overlapped. Self-attention usually uses the weighted sum (or other functions) with internal elements of each local…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Yang Du , Chunfeng Yuan , Bing Li , Lili Zhao , Yangxi Li , Weiming Hu

Modeling user preferences (long-term history) and user dynamics (short-term history) is of greatest importance to build efficient sequential recommender systems. The challenge lies in the successful combination of the whole user's history…

Machine Learning · Computer Science 2021-03-31 Corentin Lonjarret , Roch Auburtin , Céline Robardet , Marc Plantevit

Sequential fashion recommendation is of great significance in online fashion shopping, which accounts for an increasing portion of either fashion retailing or online e-commerce. The key to building an effective sequential fashion…

Information Retrieval · Computer Science 2021-06-01 Yujuan Ding , Yunshan Ma , Wai Keung Wong , Tat-Seng Chua