English
Related papers

Related papers: Self-Attentive Sequential Recommendation with Chea…

200 papers

Sequential recommendation (SR) models predict a user's next interaction by modeling their historical behaviors. Transformer-based SR methods, notably BERT4Rec, effectively capture these patterns but incur significant computational overhead…

Information Retrieval · Computer Science 2026-02-09 Shankar Veludandi , Gulrukh Kurdistan , Uzma Mushtaque

The goal of sequential event prediction is to estimate the next event based on a sequence of historical events, with applications to sequential recommendation, user behavior analysis and clinical treatment. In practice, the next-event…

Machine Learning · Computer Science 2023-01-18 Chenxiao Yang , Qitian Wu , Qingsong Wen , Zhiqiang Zhou , Liang Sun , Junchi Yan

Multi-behavior recommendation exploits multiple types of user-item interactions to alleviate the data sparsity problem faced by the traditional models that often utilize only one type of interaction for recommendation. In real scenarios,…

Information Retrieval · Computer Science 2023-07-13 Mingshi Yan , Zhiyong Cheng , Chen Gao , Jing Sun , Fan Liu , Fuming Sun , Haojie Li

Since sequential information plays an important role in modeling user behaviors, various sequential recommendation methods have been proposed. Methods based on Markov assumption are widely-used, but independently combine several most recent…

Information Retrieval · Computer Science 2016-09-20 Qiang Liu , Shu Wu , Diyi Wang , Zhaokang Li , Liang Wang

With the outbreak of today's streaming data, the sequential recommendation is a promising solution to achieve time-aware personalized modeling. It aims to infer the next interacted item of a given user based on the historical item sequence.…

Information Retrieval · Computer Science 2023-09-19 Guanyu Lin , Chen Gao , Yinfeng Li , Yu Zheng , Zhiheng Li , Depeng Jin , Dong Li , Jianye Hao , Yong Li

Recently, recommendation according to sequential user behaviors has shown promising results in many application scenarios. Generally speaking, real-world sequential user behaviors usually reflect a hybrid of sequential influences and…

Information Retrieval · Computer Science 2019-10-18 Xu Chen , Kenan Cui , Ya Zhang , Yanfeng Wang

The understanding of where humans look in a scene is a problem of great interest in visual perception and computer vision. When eye-tracking devices are not a viable option, models of human attention can be used to predict fixations. In…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Dario Zanca , Marco Gori

Sequential recommendation leverages interaction sequences to predict forthcoming user behaviors, crucial for crafting personalized recommendations. However, the true preferences of a user are inherently complex and high-dimensional, while…

Information Retrieval · Computer Science 2024-07-26 Shu Chen , Jinwei Luo , Weike Pan , Jiangxing Yu , Xin Huang , Zhong Ming

Transformer based models are increasingly being used in various domains including recommender systems (RS). Pretrained transformer models such as BERT have shown good performance at language modelling. With the greater ability to model…

Information Retrieval · Computer Science 2025-01-03 Uzma Mushtaque

Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains. One example is systems that interact with users, log user actions and behaviour, and make recommendations of items of potential…

Information Retrieval · Computer Science 2021-09-15 Christian Hansen

Self-attention (SA) has become the cornerstone of modern vision backbones for its powerful expressivity over traditional Convolutions (Conv). However, its quadratic complexity remains a critical bottleneck for practical applications. Given…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Hao Yu , Haoyu Chen , Yan Jiang , Wei Peng , Zhaodong Sun , Samuel Kaski , Guoying Zhao

When modeling a given type of data, we consider it to involve two key aspects: 1) identifying relevant elements (e.g., image pixels or textual words) to a central element, as in a convolutional receptive field, or to a query element, as in…

Machine Learning · Computer Science 2025-10-14 Hehe Fan , Yi Yang , Mohan Kankanhalli , Fei Wu

Student's academic performance prediction empowers educational technologies including academic trajectory and degree planning, course recommender systems, early warning and advising systems. Given a student's past data (such as grades in…

Machine Learning · Computer Science 2020-01-06 Qian Hu , Huzefa Rangwala

Sequential recommendation is one of the most important tasks in recommender systems, which aims to recommend the next interacted item with historical behaviors as input. Traditional sequential recommendation always mainly considers the…

Information Retrieval · Computer Science 2023-08-09 Yunzhu Pan , Chen Gao , Jianxin Chang , Yanan Niu , Yang Song , Kun Gai , Depeng Jin , Yong Li

Click-Through Rate (CTR) prediction plays an important role in many industrial applications, and recently a lot of attention is paid to the deep interest models which use attention mechanism to capture user interests from historical…

Information Retrieval · Computer Science 2021-05-24 Keke Zhao , Xing Zhao , Qi Cao , Linjian Mo

Sequential recommendations aim to capture users' preferences from their historical interactions so as to predict the next item that they will interact with. Sequential recommendation methods usually assume that all items in a user's…

Information Retrieval · Computer Science 2023-04-24 Yujie Lin , Chenyang Wang , Zhumin Chen , Zhaochun Ren , Xin Xin , Qiang Yan , Maarten de Rijke , Xiuzhen Cheng , Pengjie Ren

Transformer models have achieved remarkable success in sequential recommender systems (SRSs). However, computing the attention matrix in traditional dot-product attention mechanisms results in a quadratic complexity with sequence lengths,…

Information Retrieval · Computer Science 2024-11-05 Langming Liu , Xiangyu Zhao , Chi Zhang , Jingtong Gao , Wanyu Wang , Wenqi Fan , Yiqi Wang , Ming He , Zitao Liu , Qing Li

Self-attention has the promise of improving computer vision systems due to parameter-independent scaling of receptive fields and content-dependent interactions, in contrast to parameter-dependent scaling and content-independent interactions…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ashish Vaswani , Prajit Ramachandran , Aravind Srinivas , Niki Parmar , Blake Hechtman , Jonathon Shlens

Learning dynamic user preference has become an increasingly important component for many online platforms (e.g., video-sharing sites, e-commerce systems) to make sequential recommendations. Previous works have made many efforts to model…

Information Retrieval · Computer Science 2022-09-21 Yuhao Yang , Chao Huang , Lianghao Xia , Yuxuan Liang , Yanwei Yu , Chenliang Li

Session-based recommendation seeks to forecast the next item a user will be interested in, based on their interaction sequences. Due to limited interaction data, session-based recommendation faces the challenge of limited data availability.…

Information Retrieval · Computer Science 2024-12-17 Tiantian Liang , Zhe Yang