English
Related papers

Related papers: Optimizing Encoder-Only Transformers for Session-B…

200 papers

Since its introduction, the transformer has shifted the development trajectory away from traditional models (e.g., RNN, MLP) in time series forecasting, which is attributed to its ability to capture global dependencies within temporal…

Machine Learning · Computer Science 2025-01-07 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Most sequential recommendation models capture the features of consecutive items in a user-item interaction history. Though effective, their representation expressiveness is still hindered by the sparse learning signals. As a result, the…

Information Retrieval · Computer Science 2021-06-30 Xu Yuan , Hongshen Chen , Yonghao Song , Xiaofang Zhao , Zhuoye Ding , Zhen He , Bo Long

Session-Based Recommenders (SBRs) aim to predict users' next preferences regard to their previous interactions in sessions while there is no historical information about them. Modern SBRs utilize deep neural networks to map users' current…

Information Retrieval · Computer Science 2023-12-18 Reza Yeganegi , Saman Haratizadeh

Recently, self-attention based models have achieved state-of-the-art performance in sequential recommendation task. Following the custom from language processing, most of these models rely on a simple positional embedding to exploit the…

Machine Learning · Computer Science 2020-08-24 Sung Min Cho , Eunhyeok Park , Sungjoo Yoo

Session-based Recommender Systems (SRSs) have been actively developed to recommend the next item of an anonymous short item sequence (i.e., session). Unlike sequence-aware recommender systems where the whole interaction sequence of each…

Information Retrieval · Computer Science 2021-07-09 Junsu Cho , SeongKu Kang , Dongmin Hyun , Hwanjo Yu

Session-based recommendation tries to make use of anonymous session data to deliver high-quality recommendation under the condition that user-profiles and the complete historical behavioral data of a target user are unavailable. Previous…

Information Retrieval · Computer Science 2022-03-15 Zhi-Hong Deng , Chang-Dong Wang , Ling Huang , Jian-Huang Lai , Philip S. Yu

Recommender systems objectives can be broadly characterized as modeling user preferences over short-or long-term time horizon. A large body of previous research studied long-term recommendation through dimensionality reduction techniques…

Information Retrieval · Computer Science 2018-07-25 Kiewan Villatel , Elena Smirnova , Jérémie Mary , Philippe Preux

News recommender systems are aimed to personalize users experiences and help them to discover relevant articles from a large and dynamic search space. Therefore, news domain is a challenging scenario for recommendations, due to its sparse…

Information Retrieval · Computer Science 2018-09-18 Gabriel de Souza P. Moreira , Felipe Ferreira , Adilson Marques da Cunha

Sequential recommendation leverages interaction sequences to predict forthcoming user behaviors, crucial for crafting personalized recommendations. However, the true preferences of a user are inherently complex and high-dimensional, while…

Information Retrieval · Computer Science 2024-07-26 Shu Chen , Jinwei Luo , Weike Pan , Jiangxing Yu , Xin Huang , Zhong Ming

In order to model the evolution of user preference, we should learn user/item embeddings based on time-ordered item purchasing sequences, which is defined as Sequential Recommendation (SR) problem. Existing methods leverage sequential…

Information Retrieval · Computer Science 2021-08-24 Ziwei Fan , Zhiwei Liu , Jiawei Zhang , Yun Xiong , Lei Zheng , Philip S. Yu

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Sequential recommendation (SR), which encodes user activity to predict the next action, has emerged as a widely adopted strategy in developing commercial personalized recommendation systems. Although Transformer-based models have proven…

Information Retrieval · Computer Science 2025-04-11 Jun Yuan

In information recommendation, a session refers to a sequence of user actions within a specific time frame. Session-based recommender systems aim to capture short-term preferences and generate relevant recommendations. However, user…

Information Retrieval · Computer Science 2025-10-20 Yongzhi Jin , Kazushi Okamoto , Kei Harada , Atsushi Shibata , Koki Karube

Music streaming services often leverage sequential recommender systems to predict the best music to showcase to users based on past sequences of listening sessions. Nonetheless, most sequential recommendation methods ignore or…

Information Retrieval · Computer Science 2024-08-30 Viet-Anh Tran , Guillaume Salha-Galvan , Bruno Sguerra , Romain Hennequin

This paper presents a mathematical framework for causal nonlinear prediction in settings where observations are generated from an underlying hidden Markov model (HMM). Both the problem formulation and the proposed solution are motivated by…

Machine Learning · Computer Science 2026-03-16 Heng-Sheng Chang , Prashant G. Mehta

To analyze the scaling potential of deep tabular representation learning models, we introduce a novel Transformer-based architecture specifically tailored to tabular data and cross-table representation learning by utilizing table-specific…

Machine Learning · Computer Science 2023-10-02 Maximilian Schambach , Dominique Paul , Johannes S. Otterbach

Sequential recommendation is a task to capture hidden user preferences from historical user item interaction data and recommend next items for the user. Significant progress has been made in this domain by leveraging classification based…

Information Retrieval · Computer Science 2024-08-30 Panfeng Cao , Pietro Lio

On-device recommender systems recently have garnered increasing attention due to their advantages of providing prompt response and securing privacy. To stay current with evolving user interests, cloud-based recommender systems are…

Information Retrieval · Computer Science 2023-08-25 Xin Xia , Junliang Yu , Guandong Xu , Hongzhi Yin

This paper introduces WeatherFormer, a transformer encoder-based model designed to learn robust weather features from minimal observations. It addresses the challenge of modeling complex weather dynamics from small datasets, a bottleneck…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Adib Hasan , Mardavij Roozbehani , Munther Dahleh

Recommender systems learn from past user behavior to predict future user preferences. Intuitively, it has been established that the most recent interactions are more indicative of future preferences than older interactions. Many…

Information Retrieval · Computer Science 2025-08-07 Joey De Pauw , Bart Goethals