English
Related papers

Related papers: Caterpillar GNN: Replacing Message Passing with Ef…

200 papers

Graph neural networks (GNNs) have been widely used to predict properties and heuristics of mixed-integer linear programs (MILPs) and hence accelerate MILP solvers. This paper investigates the capacity of GNNs to represent strong branching…

Machine Learning · Computer Science 2025-01-09 Ziang Chen , Jialin Liu , Xiaohan Chen , Xinshang Wang , Wotao Yin

Message passing plays a vital role in graph neural networks (GNNs) for effective feature learning. However, the over-reliance on input topology diminishes the efficacy of message passing and restricts the ability of GNNs. Despite efforts to…

Machine Learning · Computer Science 2024-12-03 Junshu Sun , Chenxue Yang , Xiangyang Ji , Qingming Huang , Shuhui Wang

While graph neural networks (GNNs) have achieved great success in learning from graph-structured data, their reliance on local, pairwise message passing restricts their ability to capture complex, high-order subgraph patterns. leading to…

Machine Learning · Computer Science 2025-09-12 Junda Ye , Zhongbao Zhang , Li Sun , Siqiang Luo

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

Machine Learning · Computer Science 2021-06-08 Waïss Azizian , Marc Lelarge

GNNs have been proven to perform highly effective in various node-level, edge-level, and graph-level prediction tasks in several domains. Existing approaches mainly focus on static graphs. However, many graphs change over time with their…

Machine Learning · Computer Science 2022-06-22 Bahareh Najafi , Saeedeh Parsaeefard , Alberto Leon-Garcia

Implicit graph neural networks have gained popularity in recent years as they capture long-range dependencies while improving predictive performance in static graphs. Despite the tussle between performance degradation due to the…

Machine Learning · Computer Science 2024-06-27 Yongjian Zhong , Hieu Vu , Tianbao Yang , Bijaya Adhikari

Machine learning, and representation learning in particular, has the potential to facilitate drug discovery by screening billions of compounds. For example, a successful approach is representing the molecules as a graph and utilizing graph…

Quantitative Methods · Quantitative Biology 2023-04-17 Ronen Taub , Tanya Wasserman , Yonatan Savir

Deep Graph Neural Networks struggle with oversmoothing. This paper introduces a novel, physics-inspired GNN model designed to mitigate this issue. Our approach integrates with existing GNN architectures, introducing an entropy-aware message…

Machine Learning · Computer Science 2024-03-08 Philipp Nazari , Oliver Lemke , Davide Guidobene , Artiom Gesp

In graph neural networks (GNNs), message passing iteratively aggregates nodes' information from their direct neighbors while neglecting the sequential nature of multi-hop node connections. Such sequential node connections e.g., metapaths,…

Graph neural networks (GNNs) have been extensively studied for prediction tasks on graphs. As pointed out by recent studies, most GNNs assume local homophily, i.e., strong similarities in local neighborhoods. This assumption however limits…

Machine Learning · Computer Science 2021-10-04 Sean Li , Dongwoo Kim , Qing Wang

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shallow MPNNs tend to…

Machine Learning · Statistics 2022-11-08 Ningyuan Huang , Soledad Villar , Carey E. Priebe , Da Zheng , Chengyue Huang , Lin Yang , Vladimir Braverman

Graph learning tasks often hinge on identifying key substructure patterns -- such as triadic closures in social networks or benzene rings in molecular graphs -- that underpin downstream performance. However, most existing graph neural…

Machine Learning · Computer Science 2025-05-27 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Nitesh V Chawla , Chuxu Zhang , Yanfang Ye

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

Graph Neural Network (GNN), with the main idea of encoding graph structure information of graphs by propagation and aggregation, has developed rapidly. It achieved excellent performance in representation learning of multiple types of graphs…

Machine Learning · Computer Science 2024-07-04 Yushan Zhu , Wen Zhang , Yajing Xu , Zhen Yao , Mingyang Chen , Huajun Chen

Graph neural networks (GNNs) have achieved remarkable success as a framework for deep learning on graph-structured data. However, GNNs are fundamentally limited by their tree-structured inductive bias: the WL-subtree kernel formulation…

Machine Learning · Computer Science 2021-07-26 Dylan Sandfelder , Priyesh Vijayan , William L. Hamilton

Graph neural networks (GNNs) are widely used in graph learning and most architectures propagate information by passing messages between vertices. In this work, we shift our attention to GNNs that perform message passing on edges and…

Machine Learning · Computer Science 2026-02-03 Pablo Barceló , Fabian Jogl , Alexander Kozachinskiy , Matthias Lanzinger , Stefan Neumann , Cristóbal Rojas

Heterogeneous graph neural networks (HGNNs) have powerful capability to embed rich structural and semantic information of a heterogeneous graph into node representations. Existing HGNNs inherit many mechanisms from graph neural networks…

Machine Learning · Computer Science 2023-09-04 Xiaocheng Yang , Mingyu Yan , Shirui Pan , Xiaochun Ye , Dongrui Fan

The dominant paradigm for learning on graph-structured data is message passing. Despite being a strong inductive bias, the local message passing mechanism suffers from pathological issues such as over-smoothing, over-squashing, and limited…

Machine Learning · Computer Science 2025-04-15 Jacob Bamberger , Federico Barbero , Xiaowen Dong , Michael M. Bronstein

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

Machine Learning · Computer Science 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Control Flow Graphs (CFGs) are critical for analyzing program execution and characterizing malware behavior. With the growing adoption of Graph Neural Networks (GNNs), CFG-based representations have proven highly effective for malware…

Cryptography and Security · Computer Science 2025-08-22 Hossein Shokouhinejad , Griffin Higgins , Roozbeh Razavi-Far , Hesamodin Mohammadian , Ali A. Ghorbani