English
Related papers

Related papers: Learnable Model Augmentation Self-Supervised Learn…

200 papers

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Social recommendation is gaining increasing attention in various online applications, including e-commerce and online streaming, where social information is leveraged to improve user-item interaction modeling. Recently, Self-Supervised…

Information Retrieval · Computer Science 2023-11-02 Tianle Wang , Lianghao Xia , Chao Huang

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Traditional sequential recommendation methods assume that users' sequence data is clean enough to learn accurate sequence representations to reflect user preferences. In practice, users' sequences inevitably contain noise (e.g., accidental…

Information Retrieval · Computer Science 2024-03-08 Chi Zhang , Qilong Han , Rui Chen , Xiangyu Zhao , Peng Tang , Hongtao Song

Self-attention models have achieved state-of-the-art performance in sequential recommender systems by capturing the sequential dependencies among user-item interactions. However, they rely on positional embeddings to retain the sequential…

Information Retrieval · Computer Science 2022-04-26 Muyang Li , Xiangyu Zhao , Chuan Lyu , Minghao Zhao , Runze Wu , Ruocheng Guo

Sequential recommendation aims to provide users with personalized suggestions based on their historical interactions. When training sequential models, padding is a widely adopted technique for two main reasons: 1) The vast majority of…

Information Retrieval · Computer Science 2025-07-16 Yizhou Dang , Yuting Liu , Enneng Yang , Guibing Guo , Linying Jiang , Jianzhe Zhao , Xingwei Wang

Sequential recommendation is a key area in the field of recommendation systems aiming to model user interest based on historical interaction sequences with irregular intervals. While previous recurrent neural network-based and…

Information Retrieval · Computer Science 2025-12-08 Wei Xiao , Huiying Wang , Qifeng Zhou , Qing Wang

Sequential recommendation (SR) models often capture user preferences based on the historically interacted item IDs, which usually obtain sub-optimal performance when the interaction history is limited. Content-based sequential…

Information Retrieval · Computer Science 2025-10-20 Donglin Zhou , Weike Pan , Zhong Ming

Data augmentation (DA) has been widely investigated to facilitate model optimization in many tasks. However, in most cases, data augmentation is randomly performed for each training sample with a certain probability, which might incur…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Shiqi Lin , Zhizheng Zhang , Xin Li , Wenjun Zeng , Zhibo Chen

In session-based or sequential recommendation, it is important to consider a number of factors like long-term user engagement, multiple types of user-item interactions such as clicks, purchases etc. The current state-of-the-art supervised…

Machine Learning · Computer Science 2020-06-12 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Large Language Models (LLMs) have recently garnered significant attention in various domains, including recommendation systems. Recent research leverages the capabilities of LLMs to improve the performance and user modeling aspects of…

Information Retrieval · Computer Science 2024-11-05 Lei Chen , Chen Gao , Xiaoyi Du , Hengliang Luo , Depeng Jin , Yong Li , Meng Wang

Recently, Large Language Models (LLMs) have been widely employed in Conversational Recommender Systems (CRSs). Unlike traditional language model approaches that focus on training, all existing LLMs-based approaches are mainly centered…

Computation and Language · Computer Science 2025-09-26 Jianyu Wen , Jingyun Wang , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Ying Zhang

Self-supervised representation learning~(SSRL) has advanced considerably by exploiting the transformation invariance assumption under artificially designed data augmentations. While augmentation-based SSRL algorithms push the boundaries of…

Machine Learning · Computer Science 2024-03-22 Yi Sui , Tongzi Wu , Jesse C. Cresswell , Ga Wu , George Stein , Xiao Shi Huang , Xiaochen Zhang , Maksims Volkovs

Traditional recommender systems such as matrix factorization methods have primarily focused on learning a shared dense embedding space to represent both items and user preferences. Subsequently, sequence models such as RNN, GRUs, and,…

Information Retrieval · Computer Science 2024-08-27 Yaoyiran Li , Xiang Zhai , Moustafa Alzantot , Keyi Yu , Ivan Vulić , Anna Korhonen , Mohamed Hammad

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Data augmentations play an important role in the recent success of self-supervised learning (SSL). While augmentations are commonly understood to encode invariances between different views into the learned representations, this…

Machine Learning · Computer Science 2025-06-10 Shlomo Libo Feigin , Maximilian Fleissner , Debarghya Ghoshdastidar

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

Machine Learning · Computer Science 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Existing sequential recommendation methods rely on large amounts of training data and usually suffer from the data sparsity problem. To tackle this, the pre-training mechanism has been widely adopted, which attempts to leverage large-scale…

Information Retrieval · Computer Science 2021-02-23 Chaojun Xiao , Ruobing Xie , Yuan Yao , Zhiyuan Liu , Maosong Sun , Xu Zhang , Leyu Lin

Self-supervised learning (SSL) aims to find meaningful representations from unlabeled data by encoding semantic similarities through data augmentations. Despite its current popularity, theoretical insights about SSL are still scarce. For…

Machine Learning · Computer Science 2025-05-27 Maximilian Fleissner , Pascal Esser , Debarghya Ghoshdastidar

Language representation learning has emerged as a promising approach for sequential recommendation, thanks to its ability to learn generalizable representations. However, despite its advantages, this approach still struggles with data…

Information Retrieval · Computer Science 2025-08-08 Minh-Anh Nguyen , Dung D. Le