English
Related papers

Related papers: Leveraging Contrastive Learning for Enhanced Node …

200 papers

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

We present a novel graph Transformer generative adversarial network (GTGAN) to learn effective graph node relations in an end-to-end fashion for challenging graph-constrained architectural layout generation tasks. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Hao Tang , Ling Shao , Nicu Sebe , Luc Van Gool

Although graph neural networks (GNNs) have achieved impressive achievements in graph classification, they often need abundant task-specific labels, which could be extensively costly to acquire. A credible solution is to explore additional…

Machine Learning · Computer Science 2025-07-15 Nan Yin , Li Shen , Mengzhu Wang , Long Lan , Zeyu Ma , Chong Chen , Xian-Sheng Hua , Xiao Luo

The graph Transformer emerges as a new architecture and has shown superior performance on various graph mining tasks. In this work, we observe that existing graph Transformers treat nodes as independent tokens and construct a single long…

Machine Learning · Computer Science 2023-02-28 Jinsong Chen , Kaiyuan Gao , Gaichao Li , Kun He

Graph transformer has been proven as an effective graph learning method for its adoption of attention mechanism that is capable of capturing expressive representations from complex topological and feature information of graphs. Graph…

Machine Learning · Computer Science 2024-03-26 Dongqi Fu , Zhigang Hua , Yan Xie , Jin Fang , Si Zhang , Kaan Sancak , Hao Wu , Andrey Malevich , Jingrui He , Bo Long

Node classification on graphs is a significant task with a wide range of applications, including social analysis and anomaly detection. Even though graph neural networks (GNNs) have produced promising results on this task, current…

Machine Learning · Computer Science 2023-06-16 Jingyang Yuan , Xiao Luo , Yifang Qin , Yusheng Zhao , Wei Ju , Ming Zhang

Graph representation learning nowadays becomes fundamental in analyzing graph-structured data. Inspired by recent success of contrastive methods, in this paper, we propose a novel framework for unsupervised graph representation learning by…

Machine Learning · Computer Science 2020-07-14 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Graph contrastive learning has emerged as a powerful tool for unsupervised graph representation learning. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs for…

Machine Learning · Computer Science 2023-05-19 Haoran Yang , Hongxu Chen , Sixiao Zhang , Xiangguo Sun , Qian Li , Xiangyu Zhao , Guandong Xu

Graph Neural Networks (GNNs) have emerged as promising solutions for collaborative filtering (CF) through the modeling of user-item interaction graphs. The nucleus of existing GNN-based recommender systems involves recursive message passing…

Machine Learning · Computer Science 2024-05-21 Peiyan Zhang , Yuchen Yan , Xi Zhang , Chaozhuo Li , Senzhang Wang , Feiran Huang , Sunghun Kim

The Transformer architecture has gained growing attention in graph representation learning recently, as it naturally overcomes several limitations of graph neural networks (GNNs) by avoiding their strict structural inductive biases and…

Machine Learning · Statistics 2022-06-14 Dexiong Chen , Leslie O'Bray , Karsten Borgwardt

With the increasing computation of training graph neural networks (GNNs) on large-scale graphs, graph condensation (GC) has emerged as a promising solution to synthesize a compact, substitute graph of the large-scale original graph for…

Machine Learning · Computer Science 2025-10-09 Xinyi Gao , Yayong Li , Tong Chen , Guanhua Ye , Wentao Zhang , Hongzhi Yin

We show that standard Transformers without graph-specific modifications can lead to promising results in graph learning both in theory and practice. Given a graph, we simply treat all nodes and edges as independent tokens, augment them with…

Machine Learning · Computer Science 2022-10-25 Jinwoo Kim , Tien Dat Nguyen , Seonwoo Min , Sungjun Cho , Moontae Lee , Honglak Lee , Seunghoon Hong

Referring image segmentation aims to segment the target referent in an image conditioning on a natural language expression. Existing one-stage methods employ per-pixel classification frameworks, which attempt straightforwardly to align…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jiajin Tang , Ge Zheng , Cheng Shi , Sibei Yang

Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data,…

Machine Learning · Computer Science 2021-04-06 Yuning You , Tianlong Chen , Yongduo Sui , Ting Chen , Zhangyang Wang , Yang Shen

Graph representation learning (GRL) is critical for graph-structured data analysis. However, most of the existing graph neural networks (GNNs) heavily rely on labeling information, which is normally expensive to obtain in the real world.…

Machine Learning · Computer Science 2022-11-22 Yizhen Zheng , Ming Jin , Shirui Pan , Yuan-Fang Li , Hao Peng , Ming Li , Zhao Li

Graph contrastive learning (GCL) has become a powerful tool for learning graph data, but its scalability remains a significant challenge. In this work, we propose a simple yet effective training framework called Structural Compression…

Machine Learning · Computer Science 2024-05-10 Shengzhong Zhang , Wenjie Yang , Xinyuan Cao , Hongwei Zhang , Zengfeng Huang

Contrastive learning has shown great promise in the field of graph representation learning. By manually constructing positive/negative samples, most graph contrastive learning methods rely on the vector inner product based similarity metric…

Machine Learning · Computer Science 2022-07-27 Yuehui Han , Le Hui , Haobo Jiang , Jianjun Qian , Jin Xie

Recent advancements in Graph Contrastive Learning (GCL) have demonstrated remarkable effectiveness in improving graph representations. However, relying on predefined augmentations (e.g., node dropping, edge perturbation, attribute masking)…

Machine Learning · Computer Science 2025-02-27 Khaled Mohammed Saifuddin , Shihao Ji , Esra Akbas

Learning representations on large-sized graphs is a long-standing challenge due to the inter-dependence nature involved in massive data points. Transformers, as an emerging class of foundation encoders for graph-structured data, have shown…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Wentao Zhao , Chenxiao Yang , Hengrui Zhang , Fan Nie , Haitian Jiang , Yatao Bian , Junchi Yan

The dynamic characterization of functional brain networks is of great significance for elucidating the mechanisms of human brain function. Although graph neural networks have achieved remarkable progress in functional network analysis,…

Machine Learning · Computer Science 2025-04-08 ZhiTeng Zhu , Lan Yao