English
Related papers

Related papers: What Makes Graph Neural Networks Miscalibrated?

200 papers

Graph neural networks have become the standard approach for dealing with learning problems on graphs. Among the different variants of graph neural networks, graph attention networks (GATs) have been applied with great success to different…

Machine Learning · Computer Science 2023-07-18 Michail Chatzianastasis , Giannis Nikolentzos , Michalis Vazirgiannis

Miscalibration - a mismatch between a model's confidence and its correctness - of Deep Neural Networks (DNNs) makes their predictions hard to rely on. Ideally, we want networks to be accurate, calibrated and confident. We show that, as…

Machine Learning · Computer Science 2020-10-27 Jishnu Mukhoti , Viveka Kulharia , Amartya Sanyal , Stuart Golodetz , Philip H. S. Torr , Puneet K. Dokania

Graph neural networks (GNNs) have been widely applied in safety-critical applications, such as financial and medical networks, in which compromised predictions may cause catastrophic consequences. While existing research on GNN robustness…

Machine Learning · Computer Science 2025-07-28 Wencheng Zou , Nan Wu

Graph neural networks (GNNs) have brought revolutionary advancements to the field of link prediction (LP), providing powerful tools for mining potential relationships in graphs. However, existing methods face challenges when dealing with…

Machine Learning · Computer Science 2025-12-30 Huashen Lu , Wensheng Gan , Guoting Chen , Zhichao Huang , Philip S. Yu

The attention mechanism has demonstrated superior performance for inference over nodes in graph neural networks (GNNs), however, they result in a high computational burden during both training and inference. We propose FastGAT, a method to…

Machine Learning · Computer Science 2020-10-06 Rakshith S Srinivasa , Cao Xiao , Lucas Glass , Justin Romberg , Jimeng Sun

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

Machine Learning · Computer Science 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

Graph Neural Networks (GNNs) have emerged as potent tools for predicting outcomes in graph-structured data. Despite their efficacy, a significant drawback of GNNs lies in their limited ability to provide robust uncertainty estimates, posing…

Machine Learning · Computer Science 2025-03-26 S. Akansha

In this paper, we present Conjoint Attentions (CAs), a class of novel learning-to-attend strategies for graph neural networks (GNNs). Besides considering the layer-wise node features propagated within the GNN, CAs can additionally…

Machine Learning · Computer Science 2021-12-14 Tiantian He , Yew-Soon Ong , Lu Bai

Graphs are useful for representing various realworld objects. However, graph neural networks (GNNs) tend to suffer from over-smoothing, where the representations of nodes of different classes become similar as the number of layers…

Machine Learning · Computer Science 2024-10-22 Jun Kato , Airi Mita , Keita Gobara , Akihiro Inokuchi

Graph neural networks have achieved state-of-the-art accuracy for graph node classification. However, GNNs are difficult to scale to large graphs, for example frequently encountering out-of-memory errors on even moderate size graphs. Recent…

Machine Learning · Computer Science 2022-10-26 Ziyuan Wang , Feiming Yang , Rui Fan

Graph neural networks (GNNs) have been widely applied in the recommendation tasks and have obtained very appealing performance. However, most GNN-based recommendation methods suffer from the problem of data sparsity in practice. Meanwhile,…

Information Retrieval · Computer Science 2021-12-15 Yiqi Wang , Chaozhuo Li , Zheng Liu , Mingzheng Li , Jiliang Tang , Xing Xie , Lei Chen , Philip S. Yu

Graphs can facilitate modeling various complex systems such as gene networks and power grids, as well as analyzing the underlying relations within them. Learning over graphs has recently attracted increasing attention, particularly graph…

Machine Learning · Computer Science 2023-03-28 O. Deniz Kose , Yanning Shen

Graph neural networks (GNNs) are increasingly used in critical human applications for predicting node labels in attributed graphs. Their ability to aggregate features from nodes' neighbors for accurate classification also has the capacity…

Machine Learning · Computer Science 2023-08-21 Arpit Merchant , Carlos Castillo

Graph Neural Networks (GNNs) achieve strong performance on node classification tasks but remain difficult to interpret, particularly with respect to which input features drive their predictions. Existing global GNN explainers operate at the…

Machine Learning · Computer Science 2026-05-06 Rishi Raj Sahoo , Subhankar Mishra

The ATLAS experiment at the Large Hadron Collider explores the use of modern neural networks for a multi-dimensional calibration of its calorimeter signal defined by clusters of topologically connected cells (topo-clusters). The Bayesian…

High Energy Physics - Experiment · Physics 2026-02-03 ATLAS Collaboration

While Graph Neural Networks (GNNs) are remarkably successful in a variety of high-impact applications, we demonstrate that, in link prediction, the common practices of including the edges being predicted in the graph at training and/or test…

Machine Learning · Computer Science 2023-12-19 Jing Zhu , Yuhang Zhou , Vassilis N. Ioannidis , Shengyi Qian , Wei Ai , Xiang Song , Danai Koutra

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node classification, link…

Machine Learning · Computer Science 2021-04-13 Yang Ye , Shihao Ji

Volatility forecasting is essential for risk management and decision-making in financial markets. Traditional models like Generalized Autoregressive Conditional Heteroskedasticity (GARCH) effectively capture volatility clustering but often…

Mathematical Finance · Quantitative Finance 2024-10-23 Pulikandala Nithish Kumar , Nneka Umeorah , Alex Alochukwu

As graphs scale to billions of nodes and edges, graph Machine Learning workloads are constrained by the cost of multi-hop traversals over exponentially growing neighborhoods. While various system-level and algorithmic optimizations have…

Machine Learning · Computer Science 2026-03-10 Yuhang Song , Naima Abrar Shami , Romaric Duvignau , Vasiliki Kalavri