English
Related papers

Related papers: Towards Better Generalization with Flexible Repres…

200 papers

The development and evaluation of graph neural networks (GNNs) generally follow the independent and identically distributed (i.i.d.) assumption. Yet this assumption is often untenable in practice due to the uncontrollable data generation…

Machine Learning · Computer Science 2025-03-06 Yiming Xu , Bin Shi , Zhen Peng , Huixiang Liu , Bo Dong , Chen Chen

Instability of trained models, i.e., the dependence of individual node predictions on random factors, can affect reproducibility, reliability, and trust in machine learning systems. In this paper, we systematically assess the prediction…

Machine Learning · Computer Science 2022-05-23 Max Klabunde , Florian Lemmerich

Probabilistic graphical models provide a powerful tool to describe complex statistical structure, with many real-world applications in science and engineering from controlling robotic arms to understanding neuronal computations. A major…

Artificial Intelligence · Computer Science 2023-05-04 Yicheng Fei , Xaq Pitkow

Despite Graph Neural Networks (GNNs) have achieved prominent success in many graph-based learning problem, such as credit risk assessment in financial networks and fake news detection in social networks. However, the trained GNNs still make…

Machine Learning · Computer Science 2023-05-26 Zirui Liu , Zhimeng Jiang , Shaochen Zhong , Kaixiong Zhou , Li Li , Rui Chen , Soo-Hyun Choi , Xia Hu

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Graphs neural networks (GNNs) learn node features by aggregating and combining neighbor information, which have achieved promising performance on many graph tasks. However, GNNs are mostly treated as black-boxes and lack human intelligible…

Machine Learning · Computer Science 2020-06-05 Hao Yuan , Jiliang Tang , Xia Hu , Shuiwang Ji

Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static…

Machine Learning · Computer Science 2019-06-07 Darwin Saire Pilco , Adín Ramírez Rivera

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

Machine Learning · Computer Science 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen

There has been a growing interest in developing diffusion-based Graph Neural Networks (GNNs), building on the connections between message passing mechanisms in GNNs and physical diffusion processes. However, existing methods suffer from…

Machine Learning · Computer Science 2025-08-18 Asela Hevapathige , Asiri Wijesinghe , Ahad N. Zehmakan

Due to the performance degradation of graph neural networks (GNNs) under distribution shifts, the work on out-of-distribution (OOD) generalization on graphs has received widespread attention. A novel perspective involves distinguishing…

Machine Learning · Computer Science 2024-06-04 Haoran Yang , Xiaobing Pei , Kai Yuan

Previous studies have demonstrated the strong performance of Graph Neural Networks (GNNs) in node classification. However, most existing GNNs adopt a node-centric perspective and rely on global message passing, leading to high computational…

Machine Learning · Computer Science 2026-01-14 Qian Zeng , Xin Lin , Jingyi Gao , Yang Yu

Graph Neural Networks (GNNs) have demonstrated remarkable performance in a wide range of tasks, such as node classification, link prediction, and graph classification, by exploiting the structural information in graph-structured data.…

Machine Learning · Computer Science 2026-01-09 Oscar Llorente , Jaime Boal , Eugenio F. Sánchez-Úbeda , Antonio Diaz-Cano , Miguel Familiar

The graph neural network (GNN) has demonstrated its superior performance in various applications. The working mechanism behind it, however, remains mysterious. GNN models are designed to learn effective representations for graph-structured…

Machine Learning · Computer Science 2022-06-10 Zepeng Zhang , Ziping Zhao

Neural networks often struggle with high-dimensional but small sample-size tabular datasets. One reason is that current weight initialisation methods assume independence between weights, which can be problematic when there are insufficient…

Machine Learning · Computer Science 2024-08-20 Andrei Margeloiu , Nikola Simidjievski , Pietro Lio , Mateja Jamnik

Graph Neural Networks (GNNs) are neural models that leverage the dependency structure in graphical data via message passing among the graph nodes. GNNs have emerged as pivotal architectures in analyzing graph-structured data, and their…

Machine Learning · Computer Science 2024-03-19 Xu Zheng , Farhad Shirani , Tianchun Wang , Wei Cheng , Zhuomin Chen , Haifeng Chen , Hua Wei , Dongsheng Luo

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

Neural networks (NNs), despite their success and wide adoption, still struggle to extrapolate out-of-distribution (OOD), i.e., to inputs that are not well-represented by their training dataset. Addressing the OOD generalization gap is…

Machine Learning · Computer Science 2025-04-01 Robert R. Nerem , Samantha Chen , Sanjoy Dasgupta , Yusu Wang

Graph neural networks (GNNs) have become powerful tools for processing graph-based information in various domains. A desirable property of GNNs is transferability, where a trained network can swap in information from a different graph…

Machine Learning · Computer Science 2024-06-24 A. Martina Neuman , Jason J. Bramburger

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations,…

Machine Learning · Computer Science 2024-07-09 Yu Huang , Min Zhou , Menglin Yang , Zhen Wang , Muhan Zhang , Jie Wang , Hong Xie , Hao Wang , Defu Lian , Enhong Chen

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd