English
Related papers

Related papers: Sub-graph Contrast for Scalable Self-Supervised Gr…

200 papers

In recent years, graph neural networks (GNN) have achieved significant developments in a variety of graph analytical tasks. Nevertheless, GNN's superior performance will suffer from serious damage when the collected node features or…

Machine Learning · Computer Science 2023-09-07 Sichao Fu , Qinmu Peng , Yang He , Baokun Du , Xinge You

Self-supervised learning is currently gaining a lot of attention, as it allows neural networks to learn robust representations from large quantities of unlabeled data. Additionally, multi-task learning can further improve representation…

Machine Learning · Computer Science 2020-12-07 Franco Manessi , Alessandro Rozza

Graph Contrastive Learning (GCL) has emerged as a promising approach in the realm of graph self-supervised learning. Prevailing GCL methods mainly derive from the principles of contrastive learning in the field of computer vision: modeling…

Machine Learning · Computer Science 2023-08-03 Zhiyuan Ning , Pengfei Wang , Pengyang Wang , Ziyue Qiao , Wei Fan , Denghui Zhang , Yi Du , Yuanchun Zhou

Graph classification is a widely studied problem and has broad applications. In many real-world problems, the number of labeled graphs available for training classification models is limited, which renders these models prone to overfitting.…

Machine Learning · Computer Science 2020-09-15 Jiaqi Zeng , Pengtao Xie

The popularity of self-supervised learning has made it possible to train models without relying on labeled data, which saves expensive annotation costs. However, most existing self-supervised contrastive learning methods often overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Weiquan Li , Xianzhong Long , Yun Li

Pre-training Graph Neural Networks (GNN) via self-supervised contrastive learning has recently drawn lots of attention. However, most existing works focus on node-level contrastive learning, which cannot capture global graph structure. The…

Machine Learning · Computer Science 2021-04-19 Shichang Zhang , Ziniu Hu , Arjun Subramonian , Yizhou Sun

Self-supervised representation learning on text-attributed graphs, which aims to create expressive and generalizable representations for various downstream tasks, has received increasing research attention lately. However, existing methods…

Computation and Language · Computer Science 2023-10-24 Yichuan Li , Kaize Ding , Kyumin Lee

Graph Neural Networks have shown excellent performance on semi-supervised classification tasks. However, they assume access to a graph that may not be often available in practice. In the absence of any graph, constructing k-Nearest Neighbor…

Machine Learning · Computer Science 2021-02-23 Vijay Lingam , Arun Iyer , Rahul Ragesh

In regularization Self-Supervised Learning (SSL) methods for graphs, computational complexity increases with the number of nodes in graphs and embedding dimensions. To mitigate the scalability of non-contrastive graph SSL, we propose a…

Machine Learning · Computer Science 2024-02-16 Ali Saheb Pasand , Reza Moravej , Mahdi Biparva , Raika Karimi , Ali Ghodsi

In recent years, using a self-supervised learning framework to learn the general characteristics of graphs has been considered a promising paradigm for graph representation learning. The core of self-supervised learning strategies for graph…

Machine Learning · Computer Science 2022-12-09 Jiawei Zhu , Mei Hong , Ronghua Du , Haifeng Li

With the increasing computation of training graph neural networks (GNNs) on large-scale graphs, graph condensation (GC) has emerged as a promising solution to synthesize a compact, substitute graph of the large-scale original graph for…

Machine Learning · Computer Science 2025-10-09 Xinyi Gao , Yayong Li , Tong Chen , Guanhua Ye , Wentao Zhang , Hongzhi Yin

Representing a graph as a vector is a challenging task; ideally, the representation should be easily computable and conducive to efficient comparisons among graphs, tailored to the particular data and analytical task at hand. Unfortunately,…

Social and Information Networks · Computer Science 2018-11-16 Anton Tsitsulin , Davide Mottin , Panagiotis Karras , Alex Bronstein , Emmanuel Müller

Graph contrastive learning is the state-of-the-art unsupervised graph representation learning framework and has shown comparable performance with supervised approaches. However, evaluating whether the graph contrastive learning is robust to…

Machine Learning · Computer Science 2022-01-28 Sixiao Zhang , Hongxu Chen , Xiangguo Sun , Yicong Li , Guandong Xu

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

Machine Learning · Computer Science 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

Machine Learning · Computer Science 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

Recently, graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may be not optimal for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bo Jiang , Ziyan Zhang , Doudou Lin , Jin Tang

The richness in the content of various information networks such as social networks and communication networks provides the unprecedented potential for learning high-quality expressive representations without external supervision. This…

Machine Learning · Computer Science 2020-02-06 Zhen Peng , Wenbing Huang , Minnan Luo , Qinghua Zheng , Yu Rong , Tingyang Xu , Junzhou Huang

Graph representation learning has long been an important yet challenging task for various real-world applications. However, their downstream tasks are mainly performed in the settings of supervised or semi-supervised learning. Inspired by…

Machine Learning · Computer Science 2021-04-14 Shiyi Chen , Ziao Wang , Xinni Zhang , Xiaofeng Zhang , Dan Peng

Supervised learning, while prevalent for information cascade modeling, often requires abundant labeled data in training, and the trained model is not easy to generalize across tasks and datasets. It often learns task-specific…

Social and Information Networks · Computer Science 2022-02-22 Xovee Xu , Fan Zhou , Kunpeng Zhang , Siyuan Liu

Self-supervised graph representation learning (SSGRL) is a representation learning paradigm used to reduce or avoid manual labeling. An essential part of SSGRL is graph data augmentation. Existing methods usually rely on heuristics commonly…

Machine Learning · Computer Science 2024-12-25 Ahmed E. Samy , Zekarias T. Kefatoa , Sarunas Girdzijauskasa