English
Related papers

Related papers: Graphs Generalization under Distribution Shifts

200 papers

Graph Neural Network (GNN) has demonstrated extraordinary performance in classifying graph properties. However, due to the selection bias of training and testing data (e.g., training on small graphs and testing on large graphs, or training…

Machine Learning · Computer Science 2023-08-17 Bin Lu , Xiaoying Gan , Ze Zhao , Shiyu Liang , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training and testing graphs, inducing the degeneration of the generalization ability of GNNs on Out-Of-Distribution (OOD) settings. The…

Machine Learning · Computer Science 2024-03-12 Shaohua Fan , Xiao Wang , Chuan Shi , Peng Cui , Bai Wang

Graph out-of-distribution (OOD) generalization remains a major challenge in graph learning since graph neural networks (GNNs) often suffer from severe performance degradation under distribution shifts. Invariant learning, aiming to extract…

Machine Learning · Computer Science 2025-02-14 Wenyu Mao , Jiancan Wu , Haoyang Liu , Yongduo Sui , Xiang Wang

Most existing deep learning models are trained based on the closed-world assumption, where the test data is assumed to be drawn i.i.d. from the same distribution as the training data, known as in-distribution (ID). However, when models are…

Machine Learning · Computer Science 2022-11-09 Yixin Liu , Kaize Ding , Huan Liu , Shirui Pan

Graph machine learning has witnessed rapid growth, driving advancements across diverse domains. However, the in-distribution assumption, where training and testing data share the same distribution, often breaks in real-world scenarios,…

Machine Learning · Computer Science 2025-02-13 Tingyi Cai , Yunliang Jiang , Yixin Liu , Ming Li , Changqin Huang , Shirui Pan

Graph neural networks (GNNs) have been demonstrated to perform well in graph representation learning, but always lacking in generalization capability when tackling out-of-distribution (OOD) data. Graph invariant learning methods, backed by…

Machine Learning · Computer Science 2023-12-19 Tianrui Jia , Haoyang Li , Cheng Yang , Tao Tao , Chuan Shi

Out-of-distribution (OOD) generalization in Graph Neural Networks (GNNs) has gained significant attention due to its critical importance in graph-based predictions in real-world scenarios. Existing methods primarily focus on extracting a…

Machine Learning · Computer Science 2025-04-21 Bowen Liu , Haoyang Li , Shuning Wang , Shuo Nie , Shanghang Zhang

In this work, we investigate the problem of out-of-distribution (OOD) generalization for unsupervised learning methods on graph data. This scenario is particularly challenging because graph neural networks (GNNs) have been shown to be…

Machine Learning · Computer Science 2023-08-03 Yun Zhu , Haizhou Shi , Zhenshuo Zhang , Siliang Tang

Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph…

Machine Learning · Computer Science 2024-03-08 Man Wu , Xin Zheng , Qin Zhang , Xiao Shen , Xiong Luo , Xingquan Zhu , Shirui Pan

Dynamic graph neural networks (DGNNs) are increasingly pervasive in exploiting spatio-temporal patterns on dynamic graphs. However, existing works fail to generalize under distribution shifts, which are common in real-world scenarios. As…

Machine Learning · Computer Science 2023-11-21 Haonan Yuan , Qingyun Sun , Xingcheng Fu , Ziwei Zhang , Cheng Ji , Hao Peng , Jianxin Li

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

Machine Learning · Computer Science 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Graph Neural Networks (GNNs) are widely used for node classification tasks but often fail to generalize when training and test nodes come from different distributions, limiting their practicality. To overcome this, recent approaches adopt…

Machine Learning · Computer Science 2024-06-04 Weihuang Zheng , Jiashuo Liu , Jiaxing Li , Jiayun Wu , Peng Cui , Youyong Kong

Out-of-distribution (OOD) detection poses a significant challenge for Graph Neural Networks (GNNs), particularly in open-world scenarios with varying distribution shifts. Most existing OOD detection methods on graphs primarily focus on…

Machine Learning · Computer Science 2024-10-24 Zhixia He , Chen Zhao , Minglai Shao , Yujie Lin , Dong Li , Qin Tian

Graph Neural Networks (GNNs) have achieved impressive performance in graph-related tasks. However, they suffer from poor generalization on out-of-distribution (OOD) data, as they tend to learn spurious correlations. Such correlations…

Machine Learning · Statistics 2026-03-26 Bowen Lu , Liangqiang Yang , Teng Li

Graph machine learning (GML) has been successfully applied across a wide range of tasks. Nonetheless, GML faces significant challenges in generalizing over out-of-distribution (OOD) data, which raises concerns about its wider applicability.…

Machine Learning · Computer Science 2024-10-17 Jing Ma

Distribution shifts between training and testing datasets significantly impair the model performance on graph learning. A commonly-taken causal view in graph invariant learning suggests that stable predictive features of graphs are causally…

Machine Learning · Computer Science 2025-12-10 Bohan Wang , Yurui Chang , Wei Jin , Lu Lin

This paper studies a novel problem of out-of-distribution graph models merging, which aims to construct a generalized model from multiple graph models pre-trained on different domains with distribution discrepancy. This problem is…

Machine Learning · Computer Science 2026-03-18 Yidi Wang , Ziyue Qiao , Jiawei Gu , Xubin Zheng , Pengyang Wang , Xiaobing Pei , Xiao Luo

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

Machine Learning · Computer Science 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

Graph Neural Networks (GNNs) show promising results for graph tasks. However, existing GNNs' generalization ability will degrade when there exist distribution shifts between testing and training graph data. The cardinal impetus underlying…

Machine Learning · Computer Science 2023-12-21 Zhengyu Chen , Teng Xiao , Kun Kuang , Zheqi Lv , Min Zhang , Jinluan Yang , Chengqiang Lu , Hongxia Yang , Fei Wu

Although dynamic graph neural networks (DyGNNs) have demonstrated promising capabilities, most existing methods ignore out-of-distribution (OOD) shifts that commonly exist in dynamic graphs. Dynamic graph OOD generalization is non-trivial…

Machine Learning · Computer Science 2026-03-03 Xinxun Zhang , Pengfei Jiao , Mengzhou Gao , Tianpeng Li , Xuan Guo