English
Related papers

Related papers: Self-Attentive Sequential Recommendation with Chea…

200 papers

The context information such as product category plays a critical role in sequential recommendation. Recent years have witnessed a growing interest in context-aware sequential recommender systems. Existing studies often treat the contexts…

Information Retrieval · Computer Science 2020-01-15 Ke Sun , Tieyun Qian

Modern sequential recommender systems commonly use transformer-based models for next-item prediction. While these models demonstrate a strong balance between efficiency and quality, integrating interleaving features - such as the query…

Information Retrieval · Computer Science 2025-08-13 Andrii Dzhoha , Alisa Mironenko , Evgeny Labzin , Vladimir Vlasov , Maarten Versteegh , Marjan Celikik

Modeling time-evolving preferences of users with their sequential item interactions, has attracted increasing attention in many online applications. Hence, sequential recommender systems have been developed to learn the dynamic user…

Information Retrieval · Computer Science 2022-06-07 Lianghao Xia , Chao Huang , Yong Xu , Jian Pei

Self-attention models have achieved state-of-the-art performance in sequential recommender systems by capturing the sequential dependencies among user-item interactions. However, they rely on positional embeddings to retain the sequential…

Information Retrieval · Computer Science 2022-04-26 Muyang Li , Xiangyu Zhao , Chuan Lyu , Minghao Zhao , Runze Wu , Ruocheng Guo

Self-attention-based networks have achieved remarkable performance in sequential recommendation tasks. A crucial component of these models is positional encoding. In this study, we delve into the learned positional embedding, demonstrating…

Information Retrieval · Computer Science 2024-11-27 Fan Luo , Haibo He , Juan Zhang , Shenghui Xu

Graph Neural Networks have significantly advanced research in recommender systems over the past few years. These methods typically capture global interests using aggregated past interactions and rely on static embeddings of users and items…

Information Retrieval · Computer Science 2025-03-19 Ashraf Ghiye , Baptiste Barreau , Laurent Carlier , Michalis Vazirgiannis

Characterizing users' interests accurately plays a significant role in an effective recommender system. The sequential recommender system can learn powerful hidden representations of users from successive user-item interactions and dynamic…

Social and Information Networks · Computer Science 2020-11-24 Lingxiao Zhang , Jiangpeng Yan , Yujiu Yang , Xiu Li

Self-attention model have shown its flexibility in parallel computation and the effectiveness on modeling both long- and short-term dependencies. However, it calculates the dependencies between representations without considering the…

Computation and Language · Computer Science 2019-02-18 Baosong Yang , Jian Li , Derek Wong , Lidia S. Chao , Xing Wang , Zhaopeng Tu

In sequence to sequence learning, the self-attention mechanism proves to be highly effective, and achieves significant improvements in many tasks. However, the self-attention mechanism is not without its own flaws. Although self-attention…

Computation and Language · Computer Science 2019-11-22 Guangxiang Zhao , Xu Sun , Jingjing Xu , Zhiyuan Zhang , Liangchen Luo

Transformers are widely used for their ability to capture data relations in sequence processing, with great success for a wide range of static tasks. However, the computational and memory footprint of their main component, i.e., the Scaled…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ginés Carreto Picón , Illia Oleksiienko , Lukas Hedegaard , Arian Bakhtiarnia , Alexandros Iosifidis

Sequential recommendation requires the recommender to capture the evolving behavior characteristics from logged user behavior data for accurate recommendations. However, user behavior sequences are viewed as a script with multiple ongoing…

Information Retrieval · Computer Science 2022-06-15 Zhiyu Yao , Xinyang Chen , Sinan Wang , Qinyan Dai , Yumeng Li , Tanchao Zhu , Mingsheng Long

Dot-product attention has wide applications in computer vision and natural language processing. However, its memory and computational costs grow quadratically with the input size. Such growth prohibits its application on high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Zhuoran Shen , Mingyuan Zhang , Haiyu Zhao , Shuai Yi , Hongsheng Li

With the rapid growth of location-based social networks (LBSNs), Point-Of-Interest (POI) recommendation has been broadly studied in this decade. Recently, the next POI recommendation, a natural extension of POI recommendation, has attracted…

Information Retrieval · Computer Science 2021-07-01 Yang Li , Yadan Luo , Zheng Zhang , Shazia W. Sadiq , Peng Cui

Existing point-cloud based 3D object detectors use convolution-like operators to process information in a local neighbourhood with fixed-weight kernels and aggregate global context hierarchically. However, non-local neural networks and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

Feature selection is the problem of selecting a subset of features for a machine learning model that maximizes model quality subject to a budget constraint. For neural networks, prior methods, including those based on $\ell_1$…

Machine Learning · Computer Science 2024-06-19 Taisuke Yasuda , MohammadHossein Bateni , Lin Chen , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

Sequential recommendation techniques provide users with product recommendations fitting their current preferences by handling dynamic user preferences over time. Previous studies have focused on modeling sequential dynamics without much…

Information Retrieval · Computer Science 2021-05-25 Seongwon Jang , Hoyeop Lee , Hyunsouk Cho , Sehee Chung

In this paper we develop a novel recommendation model that explicitly incorporates time information. The model relies on an embedding layer and TSL attention-like mechanism with inner products in different vector spaces, that can be thought…

Sequential recommendation has become increasingly essential in various online services. It aims to model the dynamic preferences of users from their historical interactions and predict their next items. The accumulated user behavior records…

Information Retrieval · Computer Science 2021-02-19 Qiaoyu Tan , Jianwei Zhang , Ninghao Liu , Xiao Huang , Hongxia Yang , Jingren Zhou , Xia Hu

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald

Many diverse phenomena in nature often inherently encode both short- and long-term temporal dependencies, which especially result from the direction of the flow of time. In this respect, we discovered experimental evidence suggesting that…

Artificial Intelligence · Computer Science 2025-02-11 Kyung Geun Kim , Byeong Tak Lee