English
Related papers

Related papers: Frequency Enhanced Hybrid Attention Network for Se…

200 papers

Transformer-based approaches such as BERT4Rec and SASRec demonstrate strong performance in Next Item Recommendation (NIR) tasks. However, applying these architectures to Next-Basket Recommendation (NBR) tasks, which often involve highly…

Information Retrieval · Computer Science 2024-12-23 Oleg Lashinin , Denis Krasilnikov , Aleksandr Milogradskii , Marina Ananyeva

Sequential recommendation aims at understanding user preference by capturing successive behavior correlations, which are usually represented as the item purchasing sequences based on their past interactions. Existing efforts generally…

Information Retrieval · Computer Science 2024-01-23 Yifang Qin , Wei Ju , Hongjun Wu , Xiao Luo , Ming Zhang

Recent learning-based image classification and speech recognition approaches make extensive use of attention mechanisms to achieve state-of-the-art recognition power, which demonstrates the effectiveness of attention mechanisms. Motivated…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Shangao Lin , Yuan Zeng , Yi Gong

Existing sequential recommendation methods rely on large amounts of training data and usually suffer from the data sparsity problem. To tackle this, the pre-training mechanism has been widely adopted, which attempts to leverage large-scale…

Information Retrieval · Computer Science 2021-02-23 Chaojun Xiao , Ruobing Xie , Yuan Yao , Zhiyuan Liu , Maosong Sun , Xu Zhang , Leyu Lin

Although prevailing supervised and self-supervised learning augmented sequential recommendation (SeRec) models have achieved improved performance with powerful neural network architectures, we argue that they still suffer from two…

Information Retrieval · Computer Science 2025-02-14 Xinping Zhao , Baotian Hu , Yan Zhong , Shouzheng Huang , Zihao Zheng , Meng Wang , Haofen Wang , Min Zhang

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald

In modern recommender systems, sequential recommendation leverages chronological user behaviors to make effective next-item suggestions, which suffers from data sparsity issues, especially for new users. One promising line of work is the…

Information Retrieval · Computer Science 2023-11-15 Guanyu Lin , Chen Gao , Yu Zheng , Jianxin Chang , Yanan Niu , Yang Song , Kun Gai , Zhiheng Li , Depeng Jin , Yong Li , Meng Wang

In the realm of music recommendation, sequential recommender systems have shown promise in capturing the dynamic nature of music consumption. Nevertheless, traditional Transformer-based models, such as SASRec and BERT4Rec, while effective,…

Information Retrieval · Computer Science 2024-09-09 Davide Abbattista , Vito Walter Anelli , Tommaso Di Noia , Craig Macdonald , Aleksandr Vladimirovich Petrov

While some powerful neural network architectures (e.g., Transformer, Graph Neural Networks) have achieved improved performance in sequential recommendation with high-order item dependency modeling, they may suffer from poor representation…

Information Retrieval · Computer Science 2023-06-02 Yaowen Ye , Lianghao Xia , Chao Huang

In this paper, we revisited the role of data augmentation in contrastive learning for sequential recommendation, revealing its inherent bias against low-frequency items and sparse user behaviors. To address this limitation, we proposed…

Information Retrieval · Computer Science 2026-01-27 Zhikai Wang , Weihua Zhang

Sequential recommendation addresses the issue of preference drift by predicting the next item based on the user's previous behaviors. Recently, a promising approach using contrastive learning has emerged, demonstrating its effectiveness in…

Information Retrieval · Computer Science 2023-08-08 Dongjun Lee , Donggeun Ko , Jaekwang Kim

Sequential recommendation aims to recommend the next item of users' interest based on their historical interactions. Recently, the self-attention mechanism has been adapted for sequential recommendation, and demonstrated state-of-the-art…

Information Retrieval · Computer Science 2022-09-19 Bo Peng , Srinivasan Parthasarathy , Xia Ning

Attribute-aware sequential recommendation entails predicting the next item a user will interact with based on a chronologically ordered history of past interactions, enriched with item attributes. Existing methods typically leverage…

Information Retrieval · Computer Science 2026-05-08 Shereen Elsayed , Ngoc Son Le , Ahmed Rashed , Lars Schmidt-Thieme

With the increased deployment of face recognition systems in our daily lives, face presentation attack detection (PAD) is attracting much attention and playing a key role in securing face recognition systems. Despite the great performance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Meiling Fang , Naser Damer , Florian Kirchbuchner , Arjan Kuijper

In sequential recommendation (SR), the self-attention mechanism of Transformer-based models acts as a low-pass filter, limiting their ability to capture high-frequency signals that reflect short-term user interests. To overcome this, BSARec…

Information Retrieval · Computer Science 2025-12-22 Jan Hutter , Hua Chang Bakker , Stan Fris , Madelon Bernardy , Yuanna Liu

We propose HyMoERec, a novel sequential recommendation framework that addresses the limitations of uniform Position-wise Feed-Forward Networks in existing models. Current approaches treat all user interactions and items equally, overlooking…

Information Retrieval · Computer Science 2025-11-11 Kunrong Li , Zhu Sun , Kwan Hui Lim

Transformer-based approaches have demonstrated remarkable success in various sequence-based tasks. However, traditional self-attention models may not sufficiently capture the intricate dependencies within items in sequential recommendation…

Information Retrieval · Computer Science 2024-10-29 Yuli Liu , Min Liu , Xiaojing Liu

Representation learning in sequential recommendation is critical for accurately modeling user interaction patterns and improving recommendation precision. However, existing approaches predominantly emphasize item-to-item transitions, often…

Information Retrieval · Computer Science 2024-07-17 Yang Liu , Yitong Wang , Chenyue Feng

This paper presents \textbf{FreEformer}, a simple yet effective model that leverages a \textbf{Fre}quency \textbf{E}nhanced Trans\textbf{former} for multivariate time series forecasting. Our work is based on the assumption that the…

Machine Learning · Computer Science 2025-01-27 Wenzhen Yue , Yong Liu , Xianghua Ying , Bowei Xing , Ruohao Guo , Ji Shi

The attention mechanism has demonstrated remarkable potential in sequence modeling, exemplified by its successful application in natural language processing with models such as Bidirectional Encoder Representations from Transformers (BERT)…

Machine Learning · Computer Science 2025-11-26 Bowen Zhao , Huanlai Xing , Zhiwen Xiao , Jincheng Peng , Li Feng , Xinhan Wang , Rong Qu , Hui Li