English
Related papers

Related papers: Graph Masked Autoencoder for Sequential Recommenda…

200 papers

Modern techniques like contrastive learning have been effectively used in many areas, including computer vision, natural language processing, and graph-structured data. Creating positive examples that assist the model in learning robust and…

Machine Learning · Computer Science 2024-02-19 Xu Zheng , Tianchun Wang , Wei Cheng , Aitian Ma , Haifeng Chen , Mo Sha , Dongsheng Luo

Sequential recommendation (SR) models often capture user preferences based on the historically interacted item IDs, which usually obtain sub-optimal performance when the interaction history is limited. Content-based sequential…

Information Retrieval · Computer Science 2025-10-20 Donglin Zhou , Weike Pan , Zhong Ming

In the rapidly evolving field of self-supervised learning on graphs, generative and contrastive methodologies have emerged as two dominant approaches. Our study focuses on masked feature reconstruction (MFR), a generative technique where a…

Machine Learning · Computer Science 2025-12-16 Jianyuan Bo , Yuan Fang

Speech Emotion Recognition (SER) in real-world scenarios remains challenging due to severe class imbalance and the prevalence of spontaneous, natural speech. While recent approaches leverage self-supervised learning (SSL) representations…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-26 Lucas H. Ueda , João G. T. Lima , Paula D. P. Costa

Masked Autoencoders (MAE) based on a reconstruction task have risen to be a promising paradigm for self-supervised learning (SSL) and achieve state-of-the-art performance across different benchmark datasets. However, despite its impressive…

Machine Learning · Computer Science 2023-03-28 Qi Zhang , Yifei Wang , Yisen Wang

Supervised learning, while prevalent for information cascade modeling, often requires abundant labeled data in training, and the trained model is not easy to generalize across tasks and datasets. It often learns task-specific…

Social and Information Networks · Computer Science 2022-02-22 Xovee Xu , Fan Zhou , Kunpeng Zhang , Siyuan Liu

Recommender systems are frequently challenged by the data sparsity problem. One approach to mitigate this issue is through cross-domain recommendation techniques. In a cross-domain context, sharing knowledge between domains can enhance the…

Information Retrieval · Computer Science 2023-11-06 Zixuan Yi , Iadh Ounis , Craig Macdonald

Recent recommender system advancements have focused on developing sequence-based and graph-based approaches. Both approaches proved useful in modeling intricate relationships within behavioral data, leading to promising outcomes in…

Information Retrieval · Computer Science 2024-03-18 Vladimir Baikalov , Evgeny Frolov

Graph contrastive learning (GCL) learns node and graph representations by contrasting multiple views of the same graph. Existing methods typically rely on fixed, handcrafted views-usually a local and a global perspective, which limits their…

Machine Learning · Computer Science 2026-05-12 Yanan Zhao , Feng Ji , Jingyang Dai , Jiaze Ma , Keyue Jiang , Kai Zhao , Wee Peng Tay

The graph with complex annotations is the most potent data type, whose constantly evolving motivates further exploration of the unsupervised dynamic graph representation. One of the representative paradigms is graph contrastive learning. It…

Machine Learning · Computer Science 2024-12-20 Yiming Xu , Bin Shi , Teng Ma , Bo Dong , Haoyi Zhou , Qinghua Zheng

The user purchase behaviors are mainly influenced by their intentions (e.g., buying clothes for decoration, buying brushes for painting, etc.). Modeling a user's latent intention can significantly improve the performance of recommendations.…

Information Retrieval · Computer Science 2023-11-28 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Guanfeng Liu , Fuzhen Zhuang , Victor S. Sheng

Multi-label classification (MLC) is a prediction task where each sample can have more than one label. We propose a novel contrastive learning boosted multi-label prediction model based on a Gaussian mixture variational autoencoder…

Machine Learning · Computer Science 2022-06-13 Junwen Bai , Shufeng Kong , Carla P. Gomes

Graph representation learning has emerged as a cornerstone for tasks like node classification and link prediction, yet prevailing self-supervised learning (SSL) methods face challenges such as computational inefficiency, reliance on…

Machine Learning · Computer Science 2025-09-04 Srinitish Srinivasan , Omkumar CU

The success of Transformer-based models has encouraged many researchers to learn CAD models using sequence-based approaches. However, learning CAD models is still a challenge, because they can be represented as complex shapes with long…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Minseop Jung , Minseong Kim , Jibum Kim

The lack of large labeled medical imaging datasets, along with significant inter-individual variability compared to clinically established disease classes, poses significant challenges in exploiting medical imaging information in a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Matteo Ferrante , Tommaso Boccato , Simeon Spasov , Andrea Duggento , Nicola Toschi

Self-supervision is recently surging at its new frontier of graph learning. It facilitates graph representations beneficial to downstream tasks; but its success could hinge on domain knowledge for handcraft or the often expensive trials and…

Machine Learning · Computer Science 2022-01-06 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

Class Incremental Learning (CIL) aims to sequentially learn new classes while avoiding catastrophic forgetting of previous knowledge. We propose to use Masked Autoencoders (MAEs) as efficient learners for CIL. MAEs were originally designed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiang-Tian Zhai , Xialei Liu , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

In this paper, we revisited the role of data augmentation in contrastive learning for sequential recommendation, revealing its inherent bias against low-frequency items and sparse user behaviors. To address this limitation, we proposed…

Information Retrieval · Computer Science 2026-01-27 Zhikai Wang , Weihua Zhang

Recently, transformers have shown promising performance in learning graph representations. However, there are still some challenges when applying transformers to real-world scenarios due to the fact that deep transformers are hard to train…

Machine Learning · Computer Science 2022-05-13 Sixiao Zhang , Hongxu Chen , Haoran Yang , Xiangguo Sun , Philip S. Yu , Guandong Xu

Sequential recommendation is an extensively explored approach to capturing users' evolving preferences based on past interactions, aimed at predicting their next likely choice. Despite significant advancements in this domain, including…

Information Retrieval · Computer Science 2025-04-15 Kowei Shih , Yi Han , Li Tan