English
Related papers

Related papers: Graph Out-of-Distribution Generalization via Causa…

200 papers

Given the critical role of graphs in real-world applications and their high-security requirements, improving the ability of graph neural networks (GNNs) to detect out-of-distribution (OOD) data is an urgent research problem. The recent work…

Machine Learning · Computer Science 2025-04-21 Shenzhi Yang , Bin Liang , An Liu , Lin Gui , Xingkai Yao , Xiaofang Zhang

Deep neural networks often face generalization problems to handle out-of-distribution (OOD) data, and there remains a notable theoretical gap between the contributing factors and their respective impacts. Literature evidence from…

Machine Learning · Computer Science 2024-04-24 Songming Zhang , Yuxiao Luo , Qizhou Wang , Haoang Chi , Xiaofeng Chen , Bo Han , Jinyan Li

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

Machine Learning · Statistics 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu

When testing data and training data come from different distributions, deep neural networks (DNNs) will face significant safety risks in practical applications. Therefore, out-of-distribution (OOD) detection techniques, which can identify…

Machine Learning · Computer Science 2026-04-01 Cheng Yang , Yu Hao , Qi Zhang , Chuan Shi

Graphs Neural Networks (GNNs) demonstrate high-performance on the link prediction (LP) task. However, these models often rely on all dataset samples being drawn from the same distribution. In addition, graph generative models (GGMs) show a…

Machine Learning · Computer Science 2025-07-17 Jay Revolinsky , Harry Shomer , Jiliang Tang

Detecting out-of-distribution (OOD) data is essential for safe deployment of deep neural networks (DNNs). This problem becomes particularly challenging in the presence of long-tailed in-distribution (ID) datasets, often leading to high…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Nimeshika Udayangani , Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

This paper studies a novel problem of out-of-distribution graph models merging, which aims to construct a generalized model from multiple graph models pre-trained on different domains with distribution discrepancy. This problem is…

Machine Learning · Computer Science 2026-03-18 Yidi Wang , Ziyue Qiao , Jiawei Gu , Xubin Zheng , Pengyang Wang , Xiaobing Pei , Xiao Luo

Deep learning has achieved tremendous success with independent and identically distributed (i.i.d.) data. However, the performance of neural networks often degenerates drastically when encountering out-of-distribution (OoD) data, i.e., when…

Machine Learning · Computer Science 2022-04-01 Nanyang Ye , Kaican Li , Haoyue Bai , Runpeng Yu , Lanqing Hong , Fengwei Zhou , Zhenguo Li , Jun Zhu

Out-of-distribution (OOD) generalization has emerged as a critical challenge in graph learning, as real-world graph data often exhibit diverse and shifting environments that traditional models fail to generalize across. A promising solution…

Machine Learning · Computer Science 2025-08-05 Xu Shen , Yixin Liu , Yili Wang , Rui Miao , Yiwei Dai , Shirui Pan , Yi Chang , Xin Wang

Graph Out-of-Distribution (OOD) classification often suffers from sharp performance drops, particularly under category imbalance and structural noise. This work tackles two pressing challenges in this context: (1) the underperformance of…

Machine Learning · Computer Science 2025-06-25 Yang Zhou , Xiaoning Ren

Graph machine learning has witnessed rapid growth, driving advancements across diverse domains. However, the in-distribution assumption, where training and testing data share the same distribution, often breaks in real-world scenarios,…

Machine Learning · Computer Science 2025-02-13 Tingyi Cai , Yunliang Jiang , Yixin Liu , Ming Li , Changqin Huang , Shirui Pan

Evaluating the quality of post-hoc explanations for Graph Neural Networks (GNNs) remains a significant challenge. While recent years have seen an increasing development of explainability methods, current evaluation metrics (e.g., fidelity,…

Machine Learning · Computer Science 2026-02-10 Ding Zhang , Siddharth Betala , Chirag Agarwal

Detecting out-of-distribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in- and out-of-distribution data: a flow…

Machine Learning · Statistics 2020-06-16 Polina Kirichenko , Pavel Izmailov , Andrew Gordon Wilson

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

Machine Learning · Computer Science 2023-12-05 Sergey Kolesnikov

Systematic, compositional generalization beyond the training distribution remains a core challenge in machine learning -- and a critical bottleneck for the emergent reasoning abilities of modern language models. This work investigates…

Machine Learning · Computer Science 2025-10-17 Awni Altabaa , Siyu Chen , John Lafferty , Zhuoran Yang

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principles underpinning this phenomenon remain elusive. This paper…

Machine Learning · Statistics 2025-05-29 Jiawei Ge , Amanda Wang , Shange Tang , Chi Jin

Graph Neural Networks (GNNs) have shown remarkable performance on graph-structured data. However, recent empirical studies suggest that GNNs are very susceptible to distribution shift. There is still significant ambiguity about why…

Machine Learning · Computer Science 2023-06-07 Qi Zhu , Yizhu Jiao , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Graph-level representation learning is important in a wide range of applications. Existing graph-level models are generally built on i.i.d. assumption for both training and testing graphs. However, in an open world, models can encounter…

Machine Learning · Computer Science 2024-07-19 Zhihao Ding , Jieming Shi , Shiqi Shen , Xuequn Shang , Jiannong Cao , Zhipeng Wang , Zhi Gong

Prediction models often fail if train and test data do not stem from the same distribution. Out-of-distribution (OOD) generalization to unseen, perturbed test data is a desirable but difficult-to-achieve property for prediction models and…

Methodology · Statistics 2022-05-25 Lucas Kook , Beate Sick , Peter Bühlmann

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen