English
Related papers

Related papers: GAugLLM: Improving Graph Contrastive Learning for …

200 papers

Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence…

Machine Learning · Computer Science 2021-11-04 Susheel Suresh , Pan Li , Cong Hao , Jennifer Neville

Graph augmentations are essential for graph contrastive learning. Most existing works use pre-defined random augmentations, which are usually unable to adapt to different input graphs and fail to consider the impact of different nodes and…

Machine Learning · Computer Science 2023-03-28 Yifu Chen , Qianqian Ren , Liu Yong

Large scale pretrained models have revolutionized Natural Language Processing (NLP) and Computer Vision (CV), showcasing remarkable cross domain generalization abilities. However, in graph learning, models are typically trained on…

Computation and Language · Computer Science 2025-10-03 Ruyue Liu , Rong Yin , Xiangzhen Bo , Xiaoshuai Hao , Yong Liu , Jinwen Zhong , Can Ma , Weiping Wang

Large Language Models (LLMs) have shown strong performance on text-attributed graphs (TAGs) due to their superior semantic understanding ability on textual node features. However, their effectiveness as predictors in the low-resource…

Machine Learning · Computer Science 2026-04-13 Ruiyao Xu , Kaize Ding

Text-attributed graphs (TAGs) enhance graph learning by integrating rich textual semantics and topological context for each node. While boosting expressiveness, they also expose new vulnerabilities in graph learning through text-based…

Artificial Intelligence · Computer Science 2026-03-24 Zihui Chen , Yuling Wang , Pengfei Jiao , Kai Wu , Xiao Wang , Xiang Ao , Dalin Zhang

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

Machine Learning · Computer Science 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

Graph contrastive learning (GCL), as an emerging self-supervised learning technique on graphs, aims to learn representations via instance discrimination. Its performance heavily relies on graph augmentation to reflect invariant patterns…

Machine Learning · Computer Science 2023-06-22 Lu Lin , Jinghui Chen , Hongning Wang

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures;…

Machine Learning · Computer Science 2022-01-19 Yixin Liu , Yu Zheng , Daokun Zhang , Hongxu Chen , Hao Peng , Shirui Pan

Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool.…

Computation and Language · Computer Science 2025-02-10 Zehong Wang , Sidney Liu , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

Recent advancements in Graph Contrastive Learning (GCL) have demonstrated remarkable effectiveness in improving graph representations. However, relying on predefined augmentations (e.g., node dropping, edge perturbation, attribute masking)…

Machine Learning · Computer Science 2025-02-27 Khaled Mohammed Saifuddin , Shihao Ji , Esra Akbas

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedly change the graph…

Machine Learning · Computer Science 2022-11-08 Huidong Liang , Xingjian Du , Bilei Zhu , Zejun Ma , Ke Chen , Junbin Gao

Text-Attributed Graphs (TAGs), where each node is associated with text descriptions, are ubiquitous in real-world scenarios. They typically exhibit distinctive structure and domain-specific knowledge, motivating the development of a Graph…

Machine Learning · Computer Science 2025-10-21 Xi Zhu , Haochen Xue , Ziwei Zhao , Wujiang Xu , Jingyuan Huang , Minghao Guo , Qifan Wang , Kaixiong Zhou , Imran Razzak , Yongfeng Zhang

Graph representation learning, involving both node features and graph structures, is crucial for real-world applications but often encounters pervasive noise. State-of-the-art methods typically address noise by focusing separately on node…

Machine Learning · Computer Science 2024-10-17 Guangxin Su , Yifan Zhu , Wenjie Zhang , Hanchen Wang , Ying Zhang

Large Language Models (LLMs) have achieved remarkable success in natural language processing through strong semantic understanding and generation. However, their black-box nature limits structured and multi-hop reasoning. In contrast,…

Computation and Language · Computer Science 2025-10-27 Guangxin Su , Hanchen Wang , Jianwei Wang , Wenjie Zhang , Ying Zhang , Jian Pei

Graph representation learning (GRL) is critical for graph-structured data analysis. However, most of the existing graph neural networks (GNNs) heavily rely on labeling information, which is normally expensive to obtain in the real world.…

Machine Learning · Computer Science 2022-11-22 Yizhen Zheng , Ming Jin , Shirui Pan , Yuan-Fang Li , Hao Peng , Ming Li , Zhao Li

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data,…

Machine Learning · Computer Science 2021-04-06 Yuning You , Tianlong Chen , Yongduo Sui , Ting Chen , Zhangyang Wang , Yang Shen

Graphs are growing rapidly, along with the number of distinct label categories associated with them. Applications like e-commerce, healthcare, recommendation systems, and various social media platforms are rapidly moving towards graph…

Artificial Intelligence · Computer Science 2025-04-08 Aditya Hemant Shahane , Prathosh A. P , Sandeep Kumar

Graph contrastive learning (GCL) has emerged as a state-of-the-art strategy for learning representations of diverse graphs including social and biomedical networks. GCL widely uses stochastic graph topology augmentation, such as uniform…

Machine Learning · Computer Science 2024-02-22 Yucheng Wu , Leye Wang , Xiao Han , Han-Jia Ye

Recently, large language models (LLMs) have demonstrated superior capabilities in understanding and zero-shot learning on textual data, promising significant advances for many text-related domains. In the graph domain, various real-world…

Computation and Language · Computer Science 2024-02-21 Xuanwen Huang , Kaiqiao Han , Yang Yang , Dezheng Bao , Quanjin Tao , Ziwei Chai , Qi Zhu