English
Related papers

Related papers: Graph Condensation for Inductive Node Representati…

200 papers

Graph clustering aims to divide the graph into different clusters. The recently emerging deep graph clustering approaches are largely built on graph neural networks (GNN). However, GNN is designed for general graph encoding and there is a…

Machine Learning · Computer Science 2025-04-28 Zhiyuan Ning , Zaitian Wang , Ran Zhang , Ping Xu , Kunpeng Liu , Pengyang Wang , Wei Ju , Pengfei Wang , Yuanchun Zhou , Erik Cambria , Chong Chen

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

Machine Learning · Computer Science 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro

The goal of this work is to address two limitations in autoencoder-based models: latent space interpretability and compatibility with unstructured meshes. This is accomplished here with the development of a novel graph neural network (GNN)…

Machine Learning · Computer Science 2023-02-20 Shivam Barwey , Varun Shankar , Venkatasubramanian Viswanathan , Romit Maulik

Distributed Graph Neural Network (GNN) training suffers from substantial communication overhead due to the inherent neighborhood dependency in graph-structured data. This neighbor explosion problem requires workers to frequently exchange…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-27 Zizhao Zhang , Yihan Xue , Haotian Zhu , Sijia Li , Zhijun Wang , Yujie Xiao

Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications. However, the sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs. Although existing Scalable…

Machine Learning · Computer Science 2023-12-13 Xinyi Gao , Wentao Zhang , Junliang Yu , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

How can we learn effective node representations on textual graphs? Graph Neural Networks (GNNs) that use Language Models (LMs) to encode textual information of graphs achieve state-of-the-art performance in many node classification tasks.…

Graph convolutional network (GCN) is an emerging neural network approach. It learns new representation of a node by aggregating feature vectors of all neighbors in the aggregation process without considering whether the neighbors or…

Machine Learning · Computer Science 2022-04-01 Li Zhang , Heda Song , Nikolaos Aletras , Haiping Lu

Graph Neural Network (GNN) ushered in a new era of machine learning with interconnected datasets. While traditional neural networks can only be trained on independent samples, GNN allows for the inclusion of inter-sample interactions in the…

Machine Learning · Computer Science 2023-12-29 Christopher Adnel , Islem Rekik

The recent introduction of Graph Neural Networks (GNNs) and their growing popularity in the past few years has enabled the application of deep learning algorithms to non-Euclidean, graph-structured data. GNNs have achieved state-of-the-art…

Machine Learning · Computer Science 2020-10-27 Tuomas P. Oikarinen , Daniel C. Hannah , Sohrob Kazerounian

Social and information networks are gaining huge popularity recently due to their various applications. Knowledge representation through graphs in the form of nodes and edges should preserve as many characteristics of the original data as…

Machine Learning · Computer Science 2021-02-08 Rucha Bhalchandra Joshi , Subhankar Mishra

Graph representation learning has attracted much attention in supporting high quality candidate search at scale. Despite its effectiveness in learning embedding vectors for objects in the user-item interaction network, the computational…

Information Retrieval · Computer Science 2020-03-05 Qiaoyu Tan , Ninghao Liu , Xing Zhao , Hongxia Yang , Jingren Zhou , Xia Hu

Graph Neural Networks (GNNs) have been widely used for modeling graph-structured data. With the development of numerous GNN variants, recent years have witnessed groundbreaking results in improving the scalability of GNNs to work on static…

Machine Learning · Computer Science 2022-06-06 Yanping Zheng , Hanzhi Wang , Zhewei Wei , Jiajun Liu , Sibo Wang

The rapid development of Internet technology has given rise to a vast amount of graph-structured data. Graph Neural Networks (GNNs), as an effective method for various graph mining tasks, incurs substantial computational resource costs when…

Machine Learning · Computer Science 2024-03-04 Lin Wang , Wenqi Fan , Jiatong Li , Yao Ma , Qing Li

Designing effective graph neural networks (GNNs) with message passing has two fundamental challenges, i.e., determining optimal message-passing pathways and designing local aggregators. Previous methods of designing optimal pathways are…

Machine Learning · Computer Science 2024-11-01 Junshu Sun , Shuhui Wang , Chenxue Yang , Qingming Huang

As training deep learning models on large dataset takes a lot of time and resources, it is desired to construct a small synthetic dataset with which we can train deep learning models sufficiently. There are recent works that have explored…

Machine Learning · Computer Science 2022-09-12 Wei Jin , Xianfeng Tang , Haoming Jiang , Zheng Li , Danqing Zhang , Jiliang Tang , Bing Yin

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

Machine Learning · Computer Science 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

Training on large-scale graphs has achieved remarkable results in graph representation learning, but its cost and storage have raised growing concerns. As one of the most promising directions, graph condensation methods address these issues…

Machine Learning · Computer Science 2024-09-30 Tianle Zhang , Yuchen Zhang , Kun Wang , Kai Wang , Beining Yang , Kaipeng Zhang , Wenqi Shao , Ping Liu , Joey Tianyi Zhou , Yang You

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji