English
Related papers

Related papers: Architecture Matters: Uncovering Implicit Mechanis…

200 papers

Graph Self-Supervised Learning (GSSL) has emerged as a powerful paradigm for generating high-quality representations for graph-structured data. While multi-scale graph contrastive learning has received increasing attention, many existing…

Machine Learning · Computer Science 2026-05-14 Mohamed Mahmoud Amar , Nairouz Mrabah , Mohamed Bouguessa , Abdoulaye Baniré Diallo

Recently, hyperbolic space has risen as a promising alternative for semi-supervised graph representation learning. Many efforts have been made to design hyperbolic versions of neural network operations. However, the inspiring geometric…

Machine Learning · Computer Science 2022-01-24 Jiahong Liu , Menglin Yang , Min Zhou , Shanshan Feng , Philippe Fournier-Viger

Continual learning (CL) is the research field that aims to build machine learning models that can accumulate knowledge continuously over different tasks without retraining from scratch. Previous studies have shown that pre-training graph…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Wei Wei , Tom De Schepper , Kevin Mets

Graph clustering, a classical task in graph learning, involves partitioning the nodes of a graph into distinct clusters. This task has applications in various real-world scenarios, such as anomaly detection, social network analysis, and…

Machine Learning · Computer Science 2024-08-09 Xiaoyang Ji , Yuchen Zhou , Haofu Yang , Shiyue Xu , Jiahao Li

Graph neural networks (GNNs) have recently emerged as an effective collaborative filtering (CF) approaches for recommender systems. The key idea of GNN-based recommender systems is to recursively perform message passing along user-item…

Information Retrieval · Computer Science 2023-07-14 Yangqin Jiang , Chao Huang , Lianghao Xia

Graph contrastive learning (GCL) aims to learn discriminative semantic invariance by contrasting different views of the same graph that share critical topological patterns. However, existing GCL approaches with structural augmentations…

Machine Learning · Computer Science 2025-12-03 Qirui Ji , Bin Qin , Yifan Jin , Yunze Zhao , Chuxiong Sun , Changwen Zheng , Jianwen Cao , Jiangmeng Li

Most graph contrastive learning (GCL) methods heavily rely on cross-view contrast, thus facing several concomitant challenges, such as the complexity of designing effective augmentations, the potential for information loss between views,…

Machine Learning · Computer Science 2024-12-13 Qingqiang Sun , Chaoqi Chen , Ziyue Qiao , Xubin Zheng , Kai Wang

Recently, Graph Neural Networks (GNNs) achieve remarkable success in Recommendation. To reduce the influence of data sparsity, Graph Contrastive Learning (GCL) is adopted in GNN-based CF methods for enhancing performance. Most GCL methods…

Information Retrieval · Computer Science 2023-02-07 Junjie Huang , Qi Cao , Ruobing Xie , Shaoliang Zhang , Feng Xia , Huawei Shen , Xueqi Cheng

To improve the robustness of graph neural networks (GNN), graph structure learning (GSL) has attracted great interest due to the pervasiveness of noise in graph data. Many approaches have been proposed for GSL to jointly learn a clean graph…

Machine Learning · Computer Science 2023-07-06 Shaogao Lv , Gang Wen , Shiyu Liu , Linsen Wei , Ming Li

Contrastive learning is a significant paradigm in graph self-supervised learning. However, it requires negative samples to prevent model collapse and learn discriminative representations. These negative samples inevitably lead to heavy…

Machine Learning · Computer Science 2024-08-12 Yunhui Liu , Huaisong Zhang , Tieke He , Tao Zheng , Jianhua Zhao

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures;…

Machine Learning · Computer Science 2022-01-19 Yixin Liu , Yu Zheng , Daokun Zhang , Hongxu Chen , Hao Peng , Shirui Pan

Graph clustering is essential in graph analysis for revealing structural patterns and node communities. Despite recent advances in self-supervised contrastive learning that have improved clustering via structural and attribute signals,…

Machine Learning · Computer Science 2026-05-28 Lei Zhang , Fubo Sun , Haipeng Yang , Zhong Guan , Likang Wu

Recent analyses of self-supervised learning (SSL) find the following data-centric properties to be critical for learning good representations: invariance to task-irrelevant semantics, separability of classes in some latent space, and…

Machine Learning · Computer Science 2023-01-24 Puja Trivedi , Ekdeep Singh Lubana , Mark Heimann , Danai Koutra , Jayaraman J. Thiagarajan

Inspired by the successful application of contrastive learning on graphs, researchers attempt to impose graph contrastive learning approaches on heterogeneous information networks. Orthogonal to homogeneous graphs, the types of nodes and…

Machine Learning · Computer Science 2023-09-06 Yuanyuan Guo , Yu Xia , Rui Wang , Rongcheng Duan , Lu Li , Jiangmeng Li

Recently, structure-text contrastive learning has shown promising performance on text-attributed graphs by leveraging the complementary strengths of graph neural networks and language models. However, existing methods typically rely on…

Machine Learning · Computer Science 2026-01-29 Yating Ren , Yikun Ban , Huobin Tan

Graph contrastive learning (GCL) improves graph representation learning, leading to SOTA on various downstream tasks. The graph augmentation step is a vital but scarcely studied step of GCL. In this paper, we show that the node embedding…

Machine Learning · Computer Science 2022-06-14 Yifei Zhang , Hao Zhu , Zixing Song , Piotr Koniusz , Irwin King

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

Information Retrieval · Computer Science 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

Contrastive learning has gained widespread adoption for retrieval tasks due to its minimal requirement for manual annotations. However, popular training frameworks typically learn from binary (positive/negative) relevance, making them…

Information Retrieval · Computer Science 2025-04-29 Tianyu Zhu , Myong Chol Jung , Jesse Clark

Graph Neural Networks (GNNs) have become popular in Graph Representation Learning (GRL). One fundamental application is few-shot node classification. Most existing methods follow the meta learning paradigm, showing the ability of fast…

Machine Learning · Computer Science 2023-09-20 Hao Liu , Jiarui Feng , Lecheng Kong , Dacheng Tao , Yixin Chen , Muhan Zhang

Distribution shifts between training and testing samples frequently occur in practice and impede model generalization performance. This crucial challenge thereby motivates studies on domain generalization (DG), which aim to predict the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Tianxin Wei , Yifan Chen , Xinrui He , Wenxuan Bao , Jingrui He