English
Related papers

Related papers: Rethinking Spectral Augmentation for Contrast-base…

200 papers

Graph contrastive learning (GCL) has been widely used as an effective self-supervised learning method for graph representation learning. However, how to apply adequate and stable graph augmentation to generating proper views for contrastive…

Machine Learning · Computer Science 2025-01-09 Yanchen Xu , Siqi Huang , Hongyuan Zhang , Xuelong Li

Graph neural networks (GNNs) extend convolutional neural networks (CNNs) to graph-based data. A question that arises is how much performance improvement does the underlying graph structure in the GNN provide over the CNN (that ignores this…

Machine Learning · Computer Science 2020-12-17 Lavender Yao Jiang , John Shi , Mark Cheung , Oren Wright , José M. F. Moura

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

Machine Learning · Computer Science 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

Recently, contrastiveness-based augmentation surges a new climax in the computer vision domain, where some operations, including rotation, crop, and flip, combined with dedicated algorithms, dramatically increase the model generalization…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Han Yue , Chunhui Zhang , Chuxu Zhang , Hongfu Liu

Graph contrastive learning has achieved great success in pre-training graph neural networks without ground-truth labels. Leading graph contrastive learning follows the classical scheme of contrastive learning, forcing model to identify the…

Machine Learning · Computer Science 2024-12-12 Junran Wu , Xueyuan Chen , Shangzhe Li

Representing a graph as a vector is a challenging task; ideally, the representation should be easily computable and conducive to efficient comparisons among graphs, tailored to the particular data and analytical task at hand. Unfortunately,…

Social and Information Networks · Computer Science 2018-11-16 Anton Tsitsulin , Davide Mottin , Panagiotis Karras , Alex Bronstein , Emmanuel Müller

Subgraph representation learning based on Graph Neural Network (GNN) has exhibited broad applications in scientific advancements, such as predictions of molecular structure-property relationships and collective cellular function. In…

Machine Learning · Computer Science 2022-10-17 Yili Shen , Xiao Liu , Cheng-Wei Ju , Jiaxu Yan , Jun Yi , Zhou Lin , Hui Guan

The quality of graph-structured data is fundamental to the success of modern graph analysis techniques such as Graph Neural Networks (GNNs). However, real-world graph data is often suboptimal, suffering from issues such as noise and…

Machine Learning · Computer Science 2026-05-19 Shen Han , Zhiyao Zhou , Jiawei Chen , Sheng Zhou , Canghong Jin , Hai Lin , Da Zhong Li , Bingde Hu , Can Wang

Heterogeneous graphs can well describe the complex entity relationships in the real world. For example, online shopping networks contain multiple physical types of consumers and products, as well as multiple relationship types such as…

Machine Learning · Computer Science 2024-07-02 Jing Zhang , Xiaoqian Jiang , Yingjie Xie , Cangqi Zhou

Physics-informed Graph Neural Networks have achieved remarkable performance in learning through graph-structured data by mitigating common GNN challenges such as over-smoothing, over-squashing, and heterophily adaption. Despite these…

Machine Learning · Computer Science 2024-06-13 Dai Shi , Andi Han , Lequan Lin , Yi Guo , Zhiyong Wang , Junbin Gao

Real world data is mostly unlabeled or only few instances are labeled. Manually labeling data is a very expensive and daunting task. This calls for unsupervised learning techniques that are powerful enough to achieve comparable results as…

Machine Learning · Computer Science 2021-05-21 Zekarias T. Kefato , Sarunas Girdzijauskas

Spectral graph convolutional neural networks (GCNNs) have been producing encouraging results in graph classification tasks. However, most spectral GCNNs utilize fixed graphs when aggregating node features, while omitting edge feature…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yang Yi , Xuequan Lu , Shang Gao , Antonio Robles-Kelly , Yuejie Zhang

Graph Neural Networks (GNNs) are sensitive to structural noise from adversarial attacks or imperfections. Existing graph contrastive learning (GCL) methods typically rely on either random perturbations (e.g., edge dropping) for diversity or…

Machine Learning · Computer Science 2026-02-04 Hao Deng , Zhang Guo , Shuiping Gou , Bo Liu

Graph-level contrastive learning, aiming to learn the representations for each graph by contrasting two augmented graphs, has attracted considerable attention. Previous studies usually simply assume that a graph and its augmented graph as a…

Artificial Intelligence · Computer Science 2024-04-15 Yanbei Liu , Yu Zhao , Xiao Wang , Lei Geng , Zhitao Xiao

Incorporating spectral information to enhance Graph Neural Networks (GNNs) has shown promising results but raises a fundamental challenge due to the inherent ambiguity of eigenvectors. Various architectures have been proposed to address…

Machine Learning · Computer Science 2024-06-07 Bohang Zhang , Lingxiao Zhao , Haggai Maron

Graph Contrastive Learning (GCL) is a powerful self-supervised learning framework that performs data augmentation through graph perturbations, with growing applications in the analysis of biological networks such as Gene Regulatory Networks…

Machine Learning · Computer Science 2026-02-20 Sho Oshima , Yuji Okamoto , Taisei Tosaki , Ryosuke Kojima

The recent contrastive learning methods, due to their effectiveness in representation learning, have been widely applied to modeling graph data. Random perturbation is widely used to build contrastive views for graph data, which however,…

Machine Learning · Computer Science 2023-07-04 Yucheng Shi , Kaixiong Zhou , Ninghao Liu

We propose Graph Contrastive Learning (GraphCL), a general framework for learning node representations in a self supervised manner. GraphCL learns node embeddings by maximizing the similarity between the representations of two randomly…

Machine Learning · Computer Science 2020-07-17 Hakim Hafidi , Mounir Ghogho , Philippe Ciblat , Ananthram Swami

Self-supervised learning is currently gaining a lot of attention, as it allows neural networks to learn robust representations from large quantities of unlabeled data. Additionally, multi-task learning can further improve representation…

Machine Learning · Computer Science 2020-12-07 Franco Manessi , Alessandro Rozza

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…