English
Related papers

Related papers: Towards Understanding and Avoiding Limitations of …

200 papers

Graph data, also known as complex network data, is omnipresent across various domains and applications. Prior graph neural network models primarily focused on extracting task-specific structural features through supervised learning…

Machine Learning · Computer Science 2024-03-26 Hongyin Zhu

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph Convolutional Networks (GCN) is a pioneering model for graph-based semi-supervised learning. However, GCN does not perform well on sparsely-labeled graphs. Its two-layer version cannot effectively propagate the label information to…

Machine Learning · Computer Science 2025-02-24 Wei Ye , Zexi Huang , Yunqi Hong , Ambuj Singh

Graph neural networks (GNNs) have demonstrated remarkable capabilities in learning from graph-structured data, often outperforming traditional Multilayer Perceptrons (MLPs) in numerous graph-based tasks. Although existing works have…

Machine Learning · Computer Science 2025-06-09 Wei Huang , Yuan Cao , Haonan Wang , Xin Cao , Taiji Suzuki

Inspired by the extensive success of deep learning, graph neural networks (GNNs) have been proposed to learn expressive node representations and demonstrated promising performance in various graph learning tasks. However, existing endeavors…

Machine Learning · Computer Science 2022-04-05 Kaize Ding , Jianling Wang , James Caverlee , Huan Liu

Recently, machine learning, particularly message-passing graph neural networks (MPNNs), has gained traction in enhancing exact optimization algorithms. For example, MPNNs speed up solving mixed-integer optimization problems by imitating…

Machine Learning · Computer Science 2023-10-17 Chendi Qian , Didier Chételat , Christopher Morris

Graph Neural Networks (GNNs) have become a prominent approach to machine learning with graphs and have been increasingly applied in a multitude of domains. Nevertheless, since most existing GNN models are based on flat message-passing…

Machine Learning · Computer Science 2022-10-27 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

Graph Neural Networks (GNNs) are powerful to learn the representation of graph-structured data. Most of the GNNs use the message-passing scheme, where the embedding of a node is iteratively updated by aggregating the information of its…

Machine Learning · Computer Science 2020-07-28 Shuo Zhang , Lei Xie

Designing effective graph neural networks (GNNs) with message passing has two fundamental challenges, i.e., determining optimal message-passing pathways and designing local aggregators. Previous methods of designing optimal pathways are…

Machine Learning · Computer Science 2024-11-01 Junshu Sun , Shuhui Wang , Chenxue Yang , Qingming Huang

The message-passing mechanism helps Graph Neural Networks (GNNs) achieve remarkable results on various node classification tasks. Nevertheless, the recursive nodes fetching and aggregation in message-passing cause inference latency when…

Machine Learning · Computer Science 2022-10-19 Jie Chen , Shouzhen Chen , Mingyuan Bai , Junbin Gao , Junping Zhang , Jian Pu

Graph neural networks (GNNs) have become pivotal tools for processing graph-structured data, leveraging the message passing scheme as their core mechanism. However, traditional GNNs often grapple with issues such as instability,…

Spectral Theory · Mathematics 2026-05-20 Yuanhong Jiang , Dongmian Zou , Xiaoqun Zhang , Yu Guang Wang

Geometric deep learning has made great strides towards generalizing the design of structure-aware neural networks from traditional domains to non-Euclidean ones, giving rise to graph neural networks (GNN) that can be applied to…

Machine Learning · Statistics 2024-10-28 Frederik Wenkel , Yimeng Min , Matthew Hirn , Michael Perlmutter , Guy Wolf

Graph neural networks (GNNs) have received tremendous attention due to their superiority in learning node representations. These models rely on message passing and feature transformation functions to encode the structural and feature…

Machine Learning · Computer Science 2021-12-02 Kai Guo , Kaixiong Zhou , Xia Hu , Yu Li , Yi Chang , Xin Wang

Graph neural networks (GNNs) have significantly improved the representation power for graph-structured data. Despite of the recent success of GNNs, the graph convolution in most GNNs have two limitations. Since the graph convolution is…

Machine Learning · Computer Science 2021-12-30 Jinyoung Park , Sungdong Yoo , Jihwan Park , Hyunwoo J. Kim

Graph convolution networks (GCNs) have been enormously successful in learning representations over several graph-based machine learning tasks. Specific to learning rich node representations, most of the methods have solely relied on the…

Machine Learning · Computer Science 2022-11-03 Ashish Tiwari , Sresth Tosniwal , Shanmuganathan Raman

Graph convolutional neural networks have shown significant potential in natural and histopathology images. However, their use has only been studied in a single magnification or multi-magnification with late fusion. In order to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Roozbeh Bazargani , Ladan Fazli , Larry Goldenberg , Martin Gleave , Ali Bashashati , Septimiu Salcudean

Convolutional neural networks (CNN) have led to many state-of-the-art results spanning through various fields. However, a clear and profound theoretical understanding of the forward pass, the core algorithm of CNN, is still lacking. In…

Machine Learning · Statistics 2017-02-02 Vardan Papyan , Yaniv Romano , Michael Elad

Graph heterophily poses a formidable challenge to the performance of Message-passing Graph Neural Networks (MP-GNNs). The familiar low-pass filters like Graph Convolutional Networks (GCNs) face performance degradation, which can be…

Machine Learning · Computer Science 2025-09-17 Kushal Bose , Swagatam Das

Graph Neural Networks (GNNs) have shown great potential in the field of graph representation learning. Standard GNNs define a local message-passing mechanism which propagates information over the whole graph domain by stacking multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Xiaoxin He , Bryan Hooi , Thomas Laurent , Adam Perold , Yann LeCun , Xavier Bresson