English
Related papers

Related papers: Modeling Sequences as Star Graphs to Address Over-…

200 papers

Self-attention is an attention mechanism that learns a representation by relating different positions in the sequence. The transformer, which is a sequence model solely based on self-attention, and its variants achieved state-of-the-art…

Sound · Computer Science 2019-06-13 Minz Won , Sanghyuk Chun , Xavier Serra

Recommender systems (RS), which have been an essential part in a wide range of applications, can be formulated as a matrix completion (MC) problem. To boost the performance of MC, matrix completion with side information, called inductive…

Information Retrieval · Computer Science 2020-02-13 Kai-Lang Yao , Wu-Jun Li

Session-based recommendation seeks to forecast the next item a user will be interested in, based on their interaction sequences. Due to limited interaction data, session-based recommendation faces the challenge of limited data availability.…

Information Retrieval · Computer Science 2024-12-17 Tiantian Liang , Zhe Yang

Continual self-supervised learning (CSSL) methods have gained increasing attention in remote sensing (RS) due to their capability to learn new tasks sequentially from continuous streams of unlabeled data. Existing CSSL methods, while…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Lars Möllenbrok , Behnood Rasti , Begüm Demir

Attention based models have achieved many remarkable breakthroughs in numerous applications. However, the quadratic complexity of Attention makes the vanilla Attention based models hard to apply to long sequence tasks. Various improved…

Machine Learning · Computer Science 2024-09-18 Xue Wang , Tian Zhou , Jianqing Zhu , Jialin Liu , Kun Yuan , Tao Yao , Wotao Yin , Rong Jin , HanQin Cai

Generative Recommenders (GRs), exemplified by the Hierarchical Sequential Transduction Unit (HSTU), have emerged as a powerful paradigm for modeling long user interaction sequences. However, we observe that their "flat-sequence" assumption…

Information Retrieval · Computer Science 2026-03-03 Zerui Chen , Heng Chang , Tianying Liu , Chuantian Zhou , Yi Cao , Jiandong Ding , Ming Liu , Bing Qin

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

Machine Learning · Computer Science 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon

The rapid expansion of multimedia contents has led to the emergence of multimodal recommendation systems. It has attracted increasing attention in recommendation systems because its full utilization of data from different modalities…

Information Retrieval · Computer Science 2024-12-30 Zheyu Chen , Jinfeng Xu , Haibo Hu

The Session-Based Recommendation System aims to predict the user's next click based on their previous session sequence. The current studies generally learn user preferences according to the transitions of items in the user's session…

Information Retrieval · Computer Science 2023-10-06 Jinpeng Chen , Haiyang Li , Xudong Zhang , Fan Zhang , Senzhang Wang , Kaimin Wei , Jiaqi Ji

Transformer-based sequential recommendation (SR) models excel at modeling long-range dependencies in user behavior via self-attention. However, updating them with continuously arriving behavior sequences incurs high computational costs or…

Information Retrieval · Computer Science 2025-11-25 Gyuseok Lee , Hyunsik Yoo , Junyoung Hwang , SeongKu Kang , Hwanjo Yu

Session-based recommendation (SBR) aims to predict the following item a user will interact with during an ongoing session. Most existing SBR models focus on designing sophisticated neural-based encoders to learn a session representation,…

Information Retrieval · Computer Science 2024-05-03 Minjin Choi , Hye-young Kim , Hyunsouk Cho , Jongwuk Lee

Generative Recommendation (GR) has emerged as a promising paradigm by formulating item recommendation as a sequence-to-sequence generation task over item identifiers. Recent studies have incorporated multimodal signals to provide richer…

Information Retrieval · Computer Science 2026-05-20 Wei Chen , Xingyu Guo , Shuang Li , Fuwei Zhang , Meng Yuan , Jing Fan , Zhao Zhang , Deqing Wang , Fuzhen Zhuang

Session-Based Recommenders (SBRs) aim to predict users' next preferences regard to their previous interactions in sessions while there is no historical information about them. Modern SBRs utilize deep neural networks to map users' current…

Information Retrieval · Computer Science 2023-12-18 Reza Yeganegi , Saman Haratizadeh

Over-smoothing remains a fundamental challenge in deep Graph Neural Networks (GNNs), where repeated message passing causes node representations to become indistinguishable. While existing solutions, such as residual connections and skip…

Machine Learning · Computer Science 2026-04-13 Xin He , Yili Wang , Yiwei Dai , Xin Wang

In clinical practice, a segmentation network is often required to continually learn on a sequential data stream from multiple sites rather than a consolidated set, due to the storage cost and privacy restriction. However, during the…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Jingyang Zhang , Peng Xue , Ran Gu , Yuning Gu , Mianxin Liu , Yongsheng Pan , Zhiming Cui , Jiawei Huang , Lei Ma , Dinggang Shen

Modern Sequential Recommendation (SR) models commonly utilize modality features to represent items, motivated in large part by recent advancements in language and vision modeling. To do so, several works completely replace ID embeddings…

Machine Learning · Computer Science 2026-01-06 Liam Collins , Bhuvesh Kumar , Clark Mingxuan Ju , Tong Zhao , Donald Loveland , Leonardo Neves , Neil Shah

Sequential recommendation aims to provide users with personalized suggestions based on their historical interactions. When training sequential models, padding is a widely adopted technique for two main reasons: 1) The vast majority of…

Information Retrieval · Computer Science 2025-07-16 Yizhou Dang , Yuting Liu , Enneng Yang , Guibing Guo , Linying Jiang , Jianzhe Zhao , Xingwei Wang

In recent years, Graph Neural Networks (GNNs) have been popular in the graph classification task. Currently, shallow GNNs are more common due to the well-known over-smoothing problem facing deeper GNNs. However, they are sub-optimal without…

Machine Learning · Computer Science 2023-02-20 Lanning Wei , Zhiqiang He , Huan Zhao , Quanming Yao

Slot Attention (SA) lies at the heart of mainstream Object-Centric Learning (OCL). Image features can be aggregated into object-level representations by SA \textit{iteratively} refining cold-start query slots. For video, such aggregation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Rongzhen Zhao , Wenyan Yang , Juho Kannala , Joni Pajarinen

Cross-Domain Recommendation (CDR) and Cross-System Recommendation (CSR) have been proposed to improve the recommendation accuracy in a target dataset (domain/system) with the help of a source one with relatively richer information. However,…

Information Retrieval · Computer Science 2021-08-19 Feng Zhu , Yan Wang , Jun Zhou , Chaochao Chen , Longfei Li , Guanfeng Liu