English
Related papers

Related papers: Next Level Message-Passing with Hierarchical Suppo…

200 papers

Graph neural networks for heterogeneous graph embedding is to project nodes into a low-dimensional space by exploring the heterogeneity and semantics of the heterogeneous graph. However, on the one hand, most of existing heterogeneous graph…

Machine Learning · Computer Science 2022-12-01 Zezhi Shao , Yongjun Xu , Wei Wei , Fei Wang , Zhao Zhang , Feida Zhu

Graph Transformer is gaining increasing attention in the field of machine learning and has demonstrated state-of-the-art performance on benchmarks for graph representation learning. However, as current implementations of Graph Transformer…

Machine Learning · Computer Science 2023-05-08 Wenhao Zhu , Tianyu Wen , Guojie Song , Xiaojun Ma , Liang Wang

We introduce a novel variant of GNN for particle tracking called Hierarchical Graph Neural Network (HGNN). The architecture creates a set of higher-level representations which correspond to tracks and assigns spacepoints to these tracks,…

High Energy Physics - Experiment · Physics 2023-03-06 Ryan Liu , Paolo Calafiura , Steven Farrell , Xiangyang Ju , Daniel Thomas Murnane , Tuan Minh Pham

Graph Neural Networks (GNNs) are popular deep learning models designed to process graph-structured data through recursive neighborhood aggregations in the message passing process. When applied to semi-supervised node classification, the…

Machine Learning · Computer Science 2025-01-13 Kevin Mancini , Islem Rekik

Hypergraph neural networks (HGNNs) have shown remarkable potential in modeling high-order relationships that naturally arise in many real-world data domains. However, existing HGNNs often suffer from shallow propagation, oversmoothing, and…

Machine Learning · Computer Science 2026-04-14 Zhiheng Zhou , Mengyao Zhou , Xixun Lin , Xingqin Qi , Guiying Yan

Message-passing graph neural networks (MPNNs) have emerged as a powerful paradigm for graph-based machine learning. Despite their effectiveness, MPNNs face challenges such as under-reaching and over-squashing, where limited receptive fields…

Machine Learning · Computer Science 2024-12-03 Chendi Qian , Andrei Manolache , Christopher Morris , Mathias Niepert

Message Passing Neural Networks (MPNNs) are a staple of graph machine learning. MPNNs iteratively update each node's representation in an input graph by aggregating messages from the node's neighbors, which necessitates a memory complexity…

Machine Learning · Computer Science 2024-12-24 Ben Finkelshtein , İsmail İlkan Ceylan , Michael Bronstein , Ron Levie

Graph neural networks (GNNs) are a powerful inductive bias for modelling algorithmic reasoning procedures and data structures. Their prowess was mainly demonstrated on tasks featuring Markovian dynamics, where querying any associated data…

Machine Learning · Computer Science 2021-04-28 Heiko Strathmann , Mohammadamin Barekatain , Charles Blundell , Petar Veličković

While Graph Neural Networks (GNNs) have achieved remarkable success, their design largely relies on empirical intuition rather than theoretical understanding. In this paper, we present a comprehensive analysis of GNN behavior through three…

Machine Learning · Computer Science 2025-02-04 Qin Jiang , Chengjia Wang , Michael Lones , Wei Pang

Message passing plays a vital role in graph neural networks (GNNs) for effective feature learning. However, the over-reliance on input topology diminishes the efficacy of message passing and restricts the ability of GNNs. Despite efforts to…

Machine Learning · Computer Science 2024-12-03 Junshu Sun , Chenxue Yang , Xiangyang Ji , Qingming Huang , Shuhui Wang

Heterogeneous graph is a kind of data structure widely existing in real life. Nowadays, the research of graph neural network on heterogeneous graph has become more and more popular. The existing heterogeneous graph neural network algorithms…

Artificial Intelligence · Computer Science 2021-06-28 Xinliang Wu , Mengying Jiang , Guizhong Liu

Heterogeneous Graph Neural Networks (HGNNs) are powerful tools for deep learning on heterogeneous graphs. Typical HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs. Recent…

Machine Learning · Computer Science 2024-09-04 Jun Hu , Bryan Hooi , Bingsheng He

Graph neural networks operate on graph-structured data via exchanging messages along edges. One limitation of this message passing paradigm is the over-squashing problem. Over-squashing occurs when messages from a node's expanded receptive…

Machine Learning · Computer Science 2023-11-15 Thomas Christie , Yu He

Graph Neural Networks (GNNs) draw their strength from explicitly modeling the topological information of structured data. However, existing GNNs suffer from limited capability in capturing the hierarchical graph representation which plays…

Machine Learning · Computer Science 2021-03-30 Jinyu Yang , Peilin Zhao , Yu Rong , Chaochao Yan , Chunyuan Li , Hehuan Ma , Junzhou Huang

The irreducible complexity of natural phenomena has led Graph Neural Networks to be employed as a standard model to perform representation learning tasks on graph-structured data. While their capacity to capture local and global patterns is…

Machine Learning · Computer Science 2024-02-13 Lorenzo Giusti

Message passing neural networks have recently evolved into a state-of-the-art approach to representation learning on graphs. Existing methods perform synchronous message passing along all edges in multiple subsequent rounds and consequently…

Machine Learning · Computer Science 2020-12-21 Julian Busch , Jiaxing Pi , Thomas Seidl

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

Machine Learning · Computer Science 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham

Message passing neural networks (MPNNs) learn the representation of graph-structured data based on graph original information, including node features and graph structures, and have shown astonishing improvement in node classification…

Machine Learning · Computer Science 2023-01-30 Xiao Liu , Lijun Zhang , Hui Guan

Recently, graph neural networks have shown the superiority of modeling the complex topological structures in heterogeneous network-based recommender systems. Due to the diverse interactions among nodes and abundant semantics emerging from…

Machine Learning · Computer Science 2022-08-04 Tiankai Gu , Chaokun Wang , Cheng Wu , Jingcao Xu , Yunkai Lou , Changping Wang , Kai Xu , Can Ye , Yang Song

Inspired by recent improvements in point cloud processing for autonomous navigation, we focus on using hierarchical graph neural networks for processing and feature learning over large-scale outdoor LiDAR point clouds. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Arulmolivarman Thieshanthan , Amashi Niwarthana , Pamuditha Somarathne , Tharindu Wickremasinghe , Ranga Rodrigo