English
Related papers

Related papers: Architecture Matters: Uncovering Implicit Mechanis…

200 papers

Graph classification has gained significant attention due to its applications in chemistry, social networks, and bioinformatics. While Graph Neural Networks (GNNs) effectively capture local structural patterns, they often overlook global…

Machine Learning · Computer Science 2025-12-03 Ahmet Sami Korkmaz , Selim Coskunuzer , Md Joshem Uddin

Graph Contrastive Learning (GCL) has emerged as the foremost approach for self-supervised learning on graph-structured data. GCL reduces reliance on labeled data by learning robust representations from various augmented views. However,…

Machine Learning · Computer Science 2025-02-20 Ruyue Liu , Rong Yin , Yong Liu , Xiaoshuai Hao , Haichao Shi , Can Ma , Weiping Wang

Self-supervision is recently surging at its new frontier of graph learning. It facilitates graph representations beneficial to downstream tasks; but its success could hinge on domain knowledge for handcraft or the often expensive trials and…

Machine Learning · Computer Science 2022-01-06 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence…

Machine Learning · Computer Science 2021-11-04 Susheel Suresh , Pan Li , Cong Hao , Jennifer Neville

Graph contrastive learning (GCL) has attracted a surge of attention due to its superior performance for learning node/graph representations without labels. However, in practice, the underlying class distribution of unlabeled nodes for the…

Machine Learning · Computer Science 2023-05-04 Liang Zeng , Lanqing Li , Ziqi Gao , Peilin Zhao , Jian Li

Heterogeneous graph neural networks (HGNNs) have demonstrated their superiority in exploiting auxiliary information for recommendation tasks. However, graphs constructed using meta-paths in HGNNs are usually too dense and contain a large…

Information Retrieval · Computer Science 2025-06-02 Lei Sang , Yu Wang , Yiwen Zhang

Oversmoothing is a common phenomenon observed in graph neural networks (GNNs), in which an increase in the network depth leads to a deterioration in their performance. Graph contrastive learning (GCL) is emerging as a promising way of…

Machine Learning · Computer Science 2024-02-26 Jintang Li , Wangbin Sun , Ruofan Wu , Yuchang Zhu , Liang Chen , Zibin Zheng

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

Graph contrastive learning (GCL) has demonstrated great promise for learning generalizable graph representations from unlabeled data. However, conventional GCL approaches face two critical limitations: (1) the restricted expressive capacity…

Machine Learning · Computer Science 2025-08-11 Zihu Wang , Boxun Xu , Hejia Geng , Peng Li

In recent years, graph neural networks (GNN) have achieved significant developments in a variety of graph analytical tasks. Nevertheless, GNN's superior performance will suffer from serious damage when the collected node features or…

Machine Learning · Computer Science 2023-09-07 Sichao Fu , Qinmu Peng , Yang He , Baokun Du , Xinge You

Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past…

Machine Learning · Computer Science 2023-04-25 Lin Shu , Chuan Chen , Zibin Zheng

The pretasks are mainly built on mutual information estimation, which requires data augmentation to construct positive samples with similar semantics to learn invariant signals and negative samples with dissimilar semantics in order to…

Machine Learning · Computer Science 2023-03-07 Haifeng Li , Jun Cao , Jiawei Zhu , Qinyao Luo , Silu He , Xuyin Wang

Existing studies show that node representations generated by graph neural networks (GNNs) are vulnerable to adversarial attacks, such as unnoticeable perturbations of adjacent matrix and node features. Thus, it is requisite to learn robust…

Machine Learning · Computer Science 2022-04-29 Jiayan Guo , Shangyang Li , Yue Zhao , Yan Zhang

Graph contrastive learning (CL) methods learn node representations in a self-supervised manner by maximizing the similarity between the augmented node representations obtained via a GNN-based encoder. However, CL methods perform poorly on…

Machine Learning · Computer Science 2024-06-12 Wenhan Yang , Baharan Mirzasoleiman

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Attributed graph clustering holds significant importance in modern data analysis. However, due to the complexity of graph data and the heterogeneity of node attributes, leveraging graph information for clustering remains challenging. To…

Machine Learning · Computer Science 2025-08-01 Binxiong Li , Xu Xiang , Xue Li , Quanzhou Lou , Binyu Zhao , Yujie Liu , Huijie Tang , Benhan Yang

Contrastive learning (CL) has recently been demonstrated critical in improving recommendation performance. The underlying principle of CL-based recommendation models is to ensure the consistency between representations derived from…

Information Retrieval · Computer Science 2023-06-21 Junliang Yu , Xin Xia , Tong Chen , Lizhen Cui , Nguyen Quoc Viet Hung , Hongzhi Yin

Recently, graph collaborative filtering methods have been proposed as an effective recommendation approach, which can capture users' preference over items by modeling the user-item interaction graphs. In order to reduce the influence of…

Information Retrieval · Computer Science 2022-02-16 Zihan Lin , Changxin Tian , Yupeng Hou , Wayne Xin Zhao

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

Machine Learning · Computer Science 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real-world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed…

Machine Learning · Computer Science 2021-05-18 Lu Wang , Xiaofu Chang , Shuang Li , Yunfei Chu , Hui Li , Wei Zhang , Xiaofeng He , Le Song , Jingren Zhou , Hongxia Yang