English
Related papers

Related papers: Out-of-Distribution Generalization on Graphs via P…

200 papers

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

A graphical model is a structured representation of locally dependent random variables. A traditional method to reason over these random variables is to perform inference using belief propagation. When provided with the true data generating…

Machine Learning · Computer Science 2021-03-17 Victor Garcia Satorras , Max Welling

Accurate modelling and quantification of predictive uncertainty is crucial in deep learning since it allows a model to make safer decisions when the data is ambiguous and facilitates the users' understanding of the model's confidence in its…

Machine Learning · Statistics 2025-08-26 Soumyasundar Pal , Liheng Ma , Amine Natik , Yingxue Zhang , Mark Coates

In general, graph representation learning methods assume that the train and test data come from the same distribution. In this work we consider an underexplored area of an otherwise rapidly developing field of graph representation learning:…

Machine Learning · Computer Science 2021-12-08 Beatrice Bevilacqua , Yangze Zhou , Bruno Ribeiro

A fundamental computation for statistical inference and accurate decision-making is to compute the marginal probabilities or most probable states of task-relevant variables. Probabilistic graphical models can efficiently represent the…

Machine Learning · Computer Science 2019-06-28 KiJung Yoon , Renjie Liao , Yuwen Xiong , Lisa Zhang , Ethan Fetaya , Raquel Urtasun , Richard Zemel , Xaq Pitkow

Graph Neural Networks (GNNs) have demonstrated remarkable efficacy in tackling a wide array of graph-related tasks across diverse domains. However, a significant challenge lies in their propensity to generate biased predictions,…

Machine Learning · Computer Science 2025-01-03 Abdullah Alchihabi , Yuhong Guo

The exploration of Graph Neural Networks (GNNs) for processing graph-structured data has expanded, particularly their potential for causal analysis due to their universal approximation capabilities. Anticipated to significantly enhance…

Machine Learning · Computer Science 2024-01-30 Simi Job , Xiaohui Tao , Taotao Cai , Lin Li , Haoran Xie , Jianming Yong

Graph Neural Networks (GNNs) are state-of-the-art models for performing prediction tasks on graphs. While existing GNNs have shown great performance on various tasks related to graphs, little attention has been paid to the scenario where…

Machine Learning · Computer Science 2023-08-15 Yu Song , Donglin Wang

Graph is a flexible and effective tool to represent complex structures in practice and graph neural networks (GNNs) have been shown to be effective on various graph tasks with randomly separated training and testing data. In real…

Machine Learning · Computer Science 2021-10-11 Shengyu Zhang , Kun Kuang , Jiezhong Qiu , Jin Yu , Zhou Zhao , Hongxia Yang , Zhongfei Zhang , Fei Wu

Graph Neural Networks have achieved impressive results across diverse network modeling tasks, but accurately estimating uncertainty on graphs remains difficult, especially under distributional shifts. Unlike traditional uncertainty…

Machine Learning · Computer Science 2025-10-15 Fred Xu , Thomas Markovich

Despite recent success in using the invariance principle for out-of-distribution (OOD) generalization on Euclidean data (e.g., images), studies on graph data are still limited. Different from images, the complex nature of graphs poses…

Machine Learning · Computer Science 2022-10-12 Yongqiang Chen , Yonggang Zhang , Yatao Bian , Han Yang , Kaili Ma , Binghui Xie , Tongliang Liu , Bo Han , James Cheng

Graph classification is a challenging problem owing to the difficulty in quantifying the similarity between graphs or representing graphs as vectors, though there have been a few methods using graph kernels or graph neural networks (GNNs).…

Machine Learning · Computer Science 2024-08-22 Zixiao Wang , Jicong Fan

We propose an approach to do learning in Gaussian factor graphs. We treat all relevant quantities (inputs, outputs, parameters, latents) as random variables in a graphical model, and view both training and prediction as inference problems…

Machine Learning · Computer Science 2024-07-18 Seth Nabarro , Mark van der Wilk , Andrew J Davison

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in solving graph classification tasks. However, most GNN architectures aggregate information from all nodes and edges in a graph, regardless of their relevance to the…

Machine Learning · Statistics 2024-04-19 Pablo Sanchez-Martin , Kinaan Aamir Khan , Isabel Valera

Learning on graphs, where instance nodes are inter-connected, has become one of the central problems for deep learning, as relational structures are pervasive and induce data inter-dependence which hinders trivial adaptation of existing…

Machine Learning · Computer Science 2023-03-10 Qitian Wu , Yiting Chen , Chenxiao Yang , Junchi Yan

Graph Neural Networks (GNNs) have emerged as potent tools for predicting outcomes in graph-structured data. Despite their efficacy, a significant drawback of GNNs lies in their limited ability to provide robust uncertainty estimates, posing…

Machine Learning · Computer Science 2025-03-26 S. Akansha

Graph machine learning has been extensively studied in both academia and industry. Although booming with a vast number of emerging methods and techniques, most of the literature is built on the in-distribution hypothesis, i.e., testing and…

Machine Learning · Computer Science 2023-01-02 Haoyang Li , Xin Wang , Ziwei Zhang , Wenwu Zhu

Graph out-of-distribution (OOD) generalization remains a major challenge in graph learning since graph neural networks (GNNs) often suffer from severe performance degradation under distribution shifts. Invariant learning, aiming to extract…

Machine Learning · Computer Science 2025-02-14 Wenyu Mao , Jiancan Wu , Haoyang Liu , Yongduo Sui , Xiang Wang

Graph neural networks (GNNs), which propagate the node features through the edges and learn how to transform the aggregated features under label supervision, have achieved great success in supervised feature extraction for both node-level…

Machine Learning · Statistics 2022-11-01 Yilin He , Chaojie Wang , Hao Zhang , Bo Chen , Mingyuan Zhou

The increasing scale of graph datasets has significantly improved the performance of graph representation learning methods, but it has also introduced substantial training challenges. Graph dataset condensation techniques have emerged to…

Machine Learning · Computer Science 2026-05-28 Huaming Du , Yijie Huang , Su Yao , Yiying Wang , Yueyang Zhou , Jingwen Yang , Jinshi Zhang , Han Ji , Yu Zhao , Guisong Liu , Hegui Zhang , Carl Yang , Gang Kou