English
Related papers

Related papers: Can Graph Foundation Models Generalize Over Archit…

200 papers

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

Machine Learning · Computer Science 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Graph neural networks (GNNs) have achieved remarkable success in various domains, yet they often struggle with domain adaptation due to significant structural distribution shifts and insufficient exploration of transferable patterns. One of…

Machine Learning · Computer Science 2025-10-16 Haoyu Zhang , Yuxuan Cheng , Wenqi Fan , Yulong Chen , Yifan Zhang

Foundation models have achieved remarkable success across many domains, relying on pretraining over vast amounts of data. Graph-structured data often lacks the same scale as unstructured data, making the development of graph foundation…

The expressivity of Graph Neural Networks (GNNs) is dependent on the aggregation functions they employ. Theoretical works have pointed towards Sum aggregation GNNs subsuming every other GNNs, while certain practical works have observed a…

Machine Learning · Computer Science 2023-05-22 Eran Rosenbluth , Jan Toenshoff , Martin Grohe

The advent of Graph Neural Networks (GNNs) has revolutionized the field of machine learning, offering a novel paradigm for learning on graph-structured data. Unlike traditional neural networks, GNNs are capable of capturing complex…

Hardware Architecture · Computer Science 2024-06-26 Kaustubh Shivdikar

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

Graph neural networks (GNNs) have received tremendous attention due to their superiority in learning node representations. These models rely on message passing and feature transformation functions to encode the structural and feature…

Machine Learning · Computer Science 2021-12-02 Kai Guo , Kaixiong Zhou , Xia Hu , Yu Li , Yi Chang , Xin Wang

Graph Neural Networks (GNNs) have emerged as a prominent research topic in the field of machine learning. Existing GNN models are commonly categorized into two types: spectral GNNs, which are designed based on polynomial graph filters, and…

Machine Learning · Computer Science 2023-09-01 Guanyu Cui , Zhewei Wei

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

Disordered Systems and Neural Networks · Physics 2026-02-23 O. Duranthon , L. Zdeborová

Graph Neural Networks (GNNs) have demonstrated impressive performance across diverse graph-based tasks by leveraging message passing to capture complex node relationships. However, on large-scale real-world graphs, GNNs face two major…

Machine Learning · Computer Science 2026-03-10 Xiang Li , Jianpeng Qi , Haobing Liu , Yuan Cao , Guoqing Chao , Zhongying Zhao , Junyu Dong , Xinwang Liu , Yanwei Yu

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

Machine Learning · Computer Science 2021-06-08 Waïss Azizian , Marc Lelarge

World models (WMs) demonstrate strong capabilities in prediction, generation, and planning tasks. Existing WMs primarily focus on unstructured data and cannot leverage the ubiquitous structured data, often represented as graphs, in the…

Machine Learning · Computer Science 2025-07-15 Tao Feng , Yexin Wu , Guanyu Lin , Jiaxuan You

Graph Neural Networks (GNNs) have received a lot of interest in the recent times. From the early spectral architectures that could only operate on undirected graphs per a transductive learning paradigm to the current state of the art…

Machine Learning · Computer Science 2021-05-18 Pushkar Mishra , Aleksandra Piktus , Gerard Goossen , Fabrizio Silvestri

Predictive Business Process Monitoring (PBPM) aims to forecast future events in ongoing cases based on historical event logs. While Graph Neural Networks (GNNs) are well suited to capture structural dependencies in process data, existing…

Machine Learning · Computer Science 2025-11-25 Fang Wang , Ernesto Damiani

One intriguing property of deep neural networks (DNNs) is their inherent vulnerability to backdoor attacks -- a trojan model responds to trigger-embedded inputs in a highly predictable manner while functioning normally otherwise. Despite…

Machine Learning · Computer Science 2021-08-11 Zhaohan Xi , Ren Pang , Shouling Ji , Ting Wang

Graph neural network (GNN)-based fault diagnosis (FD) has received increasing attention in recent years, due to the fact that data coming from several application domains can be advantageously represented as graphs. Indeed, this particular…

Systems and Control · Electrical Eng. & Systems 2021-11-17 Zhiwen Chen , Jiamin Xu , Cesare Alippi , Steven X. Ding , Yuri Shardt , Tao Peng , Chunhua Yang

Graph neural networks (GNNs) rely on graph convolutions to extract local features from network data. These graph convolutions combine information from adjacent nodes using coefficients that are shared across all nodes. Since these…

Machine Learning · Computer Science 2020-10-22 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro

Graph foundation models (GFMs) have recently emerged as a promising paradigm for achieving broad generalization across various graph data. However, existing GFMs are often trained on datasets that may not fully reflect real-world graphs,…

Machine Learning · Computer Science 2025-10-10 Adrian Hayler , Xingyue Huang , İsmail İlkan Ceylan , Michael Bronstein , Ben Finkelshtein

In recent years, significant efforts have been made to refine the design of Graph Neural Network (GNN) layers, aiming to overcome diverse challenges, such as limited expressive power and oversmoothing. Despite their widespread adoption, the…

Machine Learning · Computer Science 2024-11-04 Moshe Eliasof , Beatrice Bevilacqua , Carola-Bibiane Schönlieb , Haggai Maron

In image generation, generative models can be evaluated naturally by visually inspecting model outputs. However, this is not always the case for graph generative models (GGMs), making their evaluation challenging. Currently, the standard…

Machine Learning · Computer Science 2022-04-29 Rylee Thompson , Boris Knyazev , Elahe Ghalebi , Jungtaek Kim , Graham W. Taylor