English
Related papers

Related papers: On the Prediction Instability of Graph Neural Netw…

200 papers

Graph neural networks (GNNs) have gained prominence in recommendation systems in recent years. By representing the user-item matrix as a bipartite and undirected graph, GNNs have demonstrated their potential to capture short- and…

Information Retrieval · Computer Science 2023-11-29 Daniele Malitesta , Claudio Pomo , Tommaso Di Noia

Predictive geometric models deliver excellent results for many Machine Learning use cases. Despite their undoubted performance, neural predictive algorithms can show unexpected degrees of instability and variance, particularly when applied…

Machine Learning · Computer Science 2018-07-20 Michaela Regneri , Malte Hoffmann , Jurij Kost , Niklas Pietsch , Timo Schulz , Sabine Stamm

Graph neural networks (GNNs) have emerged as a powerful tool for nonlinear processing of graph signals, exhibiting success in recommender systems, power outage prediction, and motion planning, among others. GNNs consists of a cascade of…

Machine Learning · Computer Science 2020-12-02 Fernando Gama , Joan Bruna , Alejandro Ribeiro

Graph Neural Networks (GNNs) have shown remarkable performance on graph-structured data. However, recent empirical studies suggest that GNNs are very susceptible to distribution shift. There is still significant ambiguity about why…

Machine Learning · Computer Science 2023-06-07 Qi Zhu , Yizhu Jiao , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by additionally making use of graph structure based on the relational inductive bias (edge bias), rather than treating the nodes as collections of independent and identically…

Machine Learning · Computer Science 2023-11-07 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Xiao-Wen Chang , Doina Precup

Graph Neural Networks (GNNs) are powerful machine learning prediction models on graph-structured data. However, GNNs lack rigorous uncertainty estimates, limiting their reliable deployment in settings where the cost of errors is…

Machine Learning · Computer Science 2023-11-01 Kexin Huang , Ying Jin , Emmanuel Candès , Jure Leskovec

Graph neural networks (GNNs) learn node representations by passing and aggregating messages between neighboring nodes. GNNs have been applied successfully in several application domains and achieved promising performance. However, GNNs…

Machine Learning · Computer Science 2021-12-14 Zeyu Zhang , Yulong Pei

In this paper we study the stability properties of aggregation graph neural networks (Agg-GNNs) considering perturbations of the underlying graph. An Agg-GNN is a hybrid architecture where information is defined on the nodes of a graph, but…

Machine Learning · Computer Science 2023-08-24 Alejandro Parada-Mayorga , Zhiyang Wang , Fernando Gama , Alejandro Ribeiro

Graph Neural Network (GNN) research has highlighted a relationship between high homophily (i.e., the tendency of nodes of the same class to connect) and strong predictive performance in node classification. However, recent work has found…

Social and Information Networks · Computer Science 2023-11-22 Donald Loveland , Jiong Zhu , Mark Heimann , Benjamin Fish , Michael T. Schaub , Danai Koutra

Deep neural networks are notoriously miscalibrated, i.e., their outputs do not reflect the true probability of the event we aim to predict. While networks for tabular or image data are usually overconfident, recent works have shown that…

Machine Learning · Computer Science 2024-03-11 Erik Nascimento , Diego Mesquita , Samuel Kaski , Amauri H Souza

Graph neural networks (GNNs) are the predominant approach for graph-based machine learning. While neural networks have shown great performance at learning useful representations, they are often criticized for their limited high-level…

Machine Learning · Computer Science 2024-07-09 Markus Zopf , Francesco Alesiani

Graph Neural Networks (GNNs) combine node attributes over a fixed granularity of the local graph structure around a node to predict its label. However, different nodes may relate to a node-level property with a different granularity of its…

Machine Learning · Computer Science 2025-06-19 Kartik Sharma , Vineeth Rakesh , Yingtong Dou , Srijan Kumar , Mahashweta Das

(1) The enhanced capability of Graph Neural Networks (GNNs) in unsupervised community detection of clustered nodes is attributed to their capacity to encode both the connectivity and feature information spaces of graphs. The identification…

Machine Learning · Computer Science 2024-01-05 William Leeney , Ryan McConville

A probability model exhibits instability if small changes in a data outcome result in large, and often unanticipated, changes in probability. This instability is a property of the probability model, given by a distributional form and a…

Statistics Theory · Mathematics 2019-11-18 Andee Kaplan , Daniel Nordman , Stephen Vardeman

Graph Neural Networks (GNNs) require a relatively large number of labeled nodes and a reliable/uncorrupted graph connectivity structure in order to obtain good performance on the semi-supervised node classification task. The performance of…

Machine Learning · Computer Science 2021-07-01 Abdullah Alchihabi , Yuhong Guo

In machine learning ensembles predictions from multiple models are aggregated. Despite widespread use and strong performance of ensembles in applied problems little is known about the mathematical properties of aggregating models and…

Machine Learning · Computer Science 2024-08-27 Jeremy Kedziora

Deployed graph neural networks (GNNs) are frozen at deployment yet must fit clean data, generalize under distribution shifts, and remain stable to perturbations. We show that static inference induces a fundamental tradeoff: improving…

Machine Learning · Computer Science 2026-02-11 Xiaoguang Guo , Zehong Wang , Jiazheng Li , Shawn Spitzel , Qi Yang , Kaize Ding , Jundong Li , Chuxu Zhang

Graph neural networks (GNNs) have become the standard tool for encoding data and their complex relationships into continuous representations, improving prediction accuracy in several machine learning tasks like node classification and link…

Machine Learning · Computer Science 2026-01-27 Megha Khosla

While Graph Neural Networks (GNNs) are remarkably successful in a variety of high-impact applications, we demonstrate that, in link prediction, the common practices of including the edges being predicted in the graph at training and/or test…

Machine Learning · Computer Science 2023-12-19 Jing Zhu , Yuhang Zhou , Vassilis N. Ioannidis , Shengyi Qian , Wei Ai , Xiang Song , Danai Koutra

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over recent years. Instance-level GNN explanation aims to discover critical input elements, like nodes or edges, that the target GNN…

Machine Learning · Computer Science 2023-09-06 Tianxiang Zhao , Dongsheng Luo , Xiang Zhang , Suhang Wang