English
Related papers

Related papers: Enhancing Size Generalization in Graph Neural Netw…

200 papers

We address the problem of disentangled representation learning with independent latent factors in graph convolutional networks (GCNs). The current methods usually learn node representation by describing its neighborhood as a perceptual…

Machine Learning · Computer Science 2019-11-27 Yanbei Liu , Xiao Wang , Shu Wu , Zhitao Xiao

Graph neural networks (GNNs) are machine learning models specialized for graph data and widely used in many applications. To train GNNs on large graphs that exceed CPU memory, several systems store data on disk and conduct out-of-core…

Machine Learning · Computer Science 2025-02-18 Renjie Liu , Yichuan Wang , Xiao Yan , Haitian Jiang , Zhenkun Cai , Minjie Wang , Bo Tang , Jinyang Li

Graph classification is a critical task in numerous multimedia applications, where graphs are employed to represent diverse types of multimedia data, including images, videos, and social networks. Nevertheless, in real-world scenarios,…

Machine Learning · Computer Science 2024-08-12 Yifan Wang , Xiao Luo , Chong Chen , Xian-Sheng Hua , Ming Zhang , Wei Ju

Graphs effectively characterize relational data, driving graph representation learning methods that uncover underlying predictive information. As state-of-the-art approaches, Graph Neural Networks (GNNs) enable end-to-end learning for…

Machine Learning · Computer Science 2025-04-24 Mao Wang , Tao Wu , Xingping Xian , Shaojie Qiao , Weina Niu , Canyixing Cui

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

State-of-the-art Graph Neural Networks (GNNs) have limited scalability with respect to the graph and model sizes. On large graphs, increasing the model depth often means exponential expansion of the scope (i.e., receptive field). Beyond…

Graph neural networks~(GNNs) apply deep learning techniques to graph-structured data and have achieved promising performance in graph representation learning. However, existing GNNs rely heavily on enough labels or well-designed negative…

Machine Learning · Computer Science 2020-11-13 Feihu Che , Guohua Yang , Dawei Zhang , Jianhua Tao , Pengpeng Shao , Tong Liu

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

Machine Learning · Computer Science 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Memory-based Temporal Graph Neural Networks are powerful tools in dynamic graph representation learning and have demonstrated superior performance in many real-world applications. However, their node memory favors smaller batch sizes to…

Machine Learning · Computer Science 2023-07-18 Hongkuan Zhou , Da Zheng , Xiang Song , George Karypis , Viktor Prasanna

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Equivariant Graph Neural Networks (GNNs) have achieved remarkable success across diverse scientific applications. However, existing approaches face critical efficiency challenges when scaling to large geometric graphs and suffer significant…

Machine Learning · Computer Science 2025-06-25 Yuelin Zhang , Jiacheng Cen , Jiaqi Han , Wenbing Huang

Node representations, or embeddings, are low-dimensional vectors that capture node properties, typically learned through unsupervised structural similarity objectives or supervised tasks. While recent efforts have focused on explaining…

Machine Learning · Computer Science 2025-10-17 Simone Piaggesi , André Panisson , Megha Khosla

Neural networks often struggle with high-dimensional but small sample-size tabular datasets. One reason is that current weight initialisation methods assume independence between weights, which can be problematic when there are insufficient…

Machine Learning · Computer Science 2024-08-20 Andrei Margeloiu , Nikola Simidjievski , Pietro Lio , Mateja Jamnik

Graph condensation (GC), which reduces the size of a large-scale graph by synthesizing a small-scale condensed graph as its substitution, has benefited various graph learning tasks. However, existing GC methods rely on centralized data…

Machine Learning · Computer Science 2024-12-23 Bo Yan , Sihao He , Cheng Yang , Shang Liu , Yang Cao , Chuan Shi

Graph neural networks (GNNs) learn representations from network data with naturally distributed architectures, rendering them well-suited candidates for decentralized learning. Oftentimes, this decentralized graph support changes with time…

Machine Learning · Computer Science 2020-10-27 Zhan Gao , Fernando Gama , Alejandro Ribeiro

Graph neural network (GNN) is effective to model graphs for distributed representations of nodes and an entire graph. Recently, research on the expressive power of GNN attracted growing attention. A highly-expressive GNN has the ability to…

Machine Learning · Computer Science 2022-03-01 Chengsheng Mao , Yuan Luo

Training Graph Neural Networks, on graphs containing billions of vertices and edges, at scale using minibatch sampling poses a key challenge: strong-scaling graphs and training examples results in lower compute and higher communication…

Machine Learning · Computer Science 2022-11-14 Md Vasimuddin , Ramanarayan Mohanty , Sanchit Misra , Sasikanth Avancha

We present Graph Neural Diffusion (GRAND) that approaches deep learning on graphs as a continuous diffusion process and treats Graph Neural Networks (GNNs) as discretisations of an underlying PDE. In our model, the layer structure and…

Graph data widely exists in real life, with large amounts of data and complex structures. It is necessary to map graph data to low-dimensional embedding. Graph classification, a critical graph task, mainly relies on identifying the…

Machine Learning · Computer Science 2023-10-26 Yuan Li , Li Liu , Penggang Chen , Youmin Zhang , Guoyin Wang

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He