English
Related papers

Related papers: ConvFormer: Revisiting Transformer for Sequential …

200 papers

Understanding dynamics from visual observations is a challenging problem that requires disentangling individual objects from the scene and learning their interactions. While recent object-centric models can successfully decompose a scene…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Ziyi Wu , Nikita Dvornik , Klaus Greff , Thomas Kipf , Animesh Garg

Sequential recommendations (SR) predict users' future interactions based on their historical behavior. The rise of Large Language Models (LLMs) has brought powerful generative and reasoning capabilities, significantly enhancing SR…

Information Retrieval · Computer Science 2026-02-09 Qiyong Zhong , Jiajie Su , Ming Yang , Yunshan Ma , Xiaolin Zheng , Chaochao Chen

Many real-world problems can be naturally described by mathematical formulas. The task of finding formulas from a set of observed inputs and outputs is called symbolic regression. Recently, neural networks have been applied to symbolic…

Machine Learning · Computer Science 2022-10-24 Martin Vastl , Jonáš Kulhánek , Jiří Kubalík , Erik Derner , Robert Babuška

Different from most conventional recommendation problems, sequential recommendation focuses on learning users' preferences by exploiting the internal order and dependency among the interacted items, which has received significant attention…

Information Retrieval · Computer Science 2025-03-14 Liwei Pan , Weike Pan , Meiyan Wei , Hongzhi Yin , Zhong Ming

We present a conformal prediction method for time series using the Transformer architecture to capture long-memory and long-range dependencies. Specifically, we use the Transformer decoder as a conditional quantile estimator to predict the…

Machine Learning · Computer Science 2024-06-11 Junghwan Lee , Chen Xu , Yao Xie

Sequential recommendations have drawn significant attention in modeling the user's historical behaviors to predict the next item. With the booming development of multimodal data (e.g., image, text) on internet platforms, sequential…

Information Retrieval · Computer Science 2024-12-12 Changhong Li , Zhiqiang Guo

Transformer and its variants are a powerful class of architectures for sequential recommendation, owing to their ability of capturing a user's dynamic interests from their past interactions. Despite their success, Transformer-based models…

Information Retrieval · Computer Science 2023-08-22 Vivian Lai , Huiyuan Chen , Chin-Chia Michael Yeh , Minghua Xu , Yiwei Cai , Hao Yang

Traditional recommender systems primarily rely on a single type of user-item interaction, such as item purchases or ratings, to predict user preferences. However, in real-world scenarios, users engage in a variety of behaviors, such as…

Information Retrieval · Computer Science 2025-03-11 Kyungho Kim , Sunwoo Kim , Geon Lee , Jinhong Jung , Kijung Shin

Online e-commerce platforms have been extending in-store shopping, which allows users to keep the canonical online browsing and checkout experience while exploring in-store shopping. However, the growing transition between online and…

With the increasing development of e-commerce and online services, personalized recommendation systems have become crucial for enhancing user satisfaction and driving business revenue. Traditional sequential recommendation methods that rely…

Information Retrieval · Computer Science 2023-04-27 Kunzhe Song , Qingfeng Sun , Can Xu , Kai Zheng , Yaming Yang

Convolutional Neural Networks (CNNs) have been recently introduced in the domain of session-based next item recommendation. An ordered collection of past items the user has interacted with in a session (or sequence) are embedded into a…

Information Retrieval · Computer Science 2018-11-30 Fajie Yuan , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M Jose , Xiangnan He

Sequential models that encode user activity for next action prediction have become a popular design choice for building web-scale personalized recommendation systems. Traditional methods of sequential recommendation either utilize…

In this paper, we present sequeval, a software tool capable of performing the offline evaluation of a recommender system designed to suggest a sequence of items. A sequence-based recommender is trained considering the sequences already…

Information Retrieval · Computer Science 2018-11-30 Diego Monti , Enrico Palumbo , Giuseppe Rizzo , Maurizio Morisio

Research in efficient vision backbones is evolving into models that are a mixture of convolutions and transformer blocks. A smart combination of both, architecture-wise and component-wise is mandatory to excel in the speedaccuracy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Moritz Nottebaum , Matteo Dunnhofer , Christian Micheloni

To capture user preference, transformer models have been widely applied to model sequential user behavior data. The core of transformer architecture lies in the self-attention mechanism, which computes the pairwise attention scores in a…

Information Retrieval · Computer Science 2024-04-05 Zhen Tian , Wayne Xin Zhao , Changwang Zhang , Xin Zhao , Zhongrui Ma , Ji-Rong Wen

We conduct a systematic study of the approximation properties of Transformer for sequence modeling with long, sparse and complicated memory. We investigate the mechanisms through which different components of Transformer, such as the…

Machine Learning · Computer Science 2024-10-31 Mingze Wang , Weinan E

The challenging task of multi-object tracking (MOT) requires simultaneous reasoning about track initialization, identity, and spatio-temporal trajectories. We formulate this task as a frame-to-frame set prediction problem and introduce…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Tim Meinhardt , Alexander Kirillov , Laura Leal-Taixe , Christoph Feichtenhofer

Predicting pedestrian behavior is a crucial task for intelligent driving systems. Accurate predictions require a deep understanding of various contextual elements that potentially impact the way pedestrians behave. To address this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Amir Rasouli , Iuliia Kotseruba

Sequential recommendation tasks, which aim to predict the next item a user will interact with, typically rely on models trained solely on historical data. However, in real-world scenarios, user behavior can fluctuate in the long interaction…

Information Retrieval · Computer Science 2024-10-01 Zhaoqi Yang , Yanan Wang , Yong Ge

Biometrics on mobile devices has attracted a lot of attention in recent years as it is considered a user-friendly authentication method. This interest has also been motivated by the success of Deep Learning (DL). Architectures based on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Paula Delgado-Santos , Ruben Tolosana , Richard Guest , Farzin Deravi , Ruben Vera-Rodriguez