English
Related papers

Related papers: Improving Graph Out-of-distribution Generalization…

200 papers

Detecting out-of-distribution (OOD) graphs is crucial for ensuring the safety and reliability of Graph Neural Networks. In unsupervised graph-level OOD detection, models are typically trained using only in-distribution (ID) data, resulting…

Machine Learning · Computer Science 2026-03-03 Li Sun , Lanxu Yang , Jiayu Tian , Bowen Fang , Xiaoyan Yu , Junda Ye , Peng Tang , Hao Peng , Philip S. Yu

While deep learning demonstrates its strong ability to handle independent and identically distributed (IID) data, it often suffers from out-of-distribution (OoD) generalization, where the test data come from another distribution (w.r.t. the…

Machine Learning · Computer Science 2020-12-18 Haoyue Bai , Rui Sun , Lanqing Hong , Fengwei Zhou , Nanyang Ye , Han-Jia Ye , S. -H. Gary Chan , Zhenguo Li

In general, graph representation learning methods assume that the train and test data come from the same distribution. In this work we consider an underexplored area of an otherwise rapidly developing field of graph representation learning:…

Machine Learning · Computer Science 2021-12-08 Beatrice Bevilacqua , Yangze Zhou , Bruno Ribeiro

Graph neural networks (GNNs) are proven effective in extracting complex node and structural information from graph data. While current GNNs perform well in node classification tasks within in-distribution (ID) settings, real-world scenarios…

Machine Learning · Computer Science 2025-05-08 Tao Yin , Chen Zhao , Xiaoyan Liu , Minglai Shao

Invariant learning methods, aimed at identifying a consistent predictor across multiple environments, are gaining prominence in out-of-distribution (OOD) generalization. Yet, when environments aren't inherent in the data, practitioners must…

Machine Learning · Computer Science 2024-05-24 Yufan Liao , Qi Wu , Zhaodi Wu , Xing Yan

Out-of-distribution (OOD) detection in graphs is critical for ensuring model robustness in open-world and safety-sensitive applications. Existing graph OOD detection approaches typically train an in-distribution (ID) classifier on ID data…

Machine Learning · Computer Science 2025-05-20 Haoyan Xu , Zhengtao Yao , Ziyi Wang , Zhan Cheng , Xiyang Hu , Mengyuan Li , Yue Zhao

Graph neural networks (GNNs) have exhibited remarkable performance under the assumption that test data comes from the same distribution of training data. However, in real-world scenarios, this assumption may not always be valid.…

Machine Learning · Computer Science 2024-02-15 Kai Guo , Hongzhi Wen , Wei Jin , Yaming Guo , Jiliang Tang , Yi Chang

Recent empirical studies on domain generalization (DG) have shown that DG algorithms that perform well on some distribution shifts fail on others, and no state-of-the-art DG algorithm performs consistently well on all shifts. Moreover,…

Machine Learning · Computer Science 2024-05-21 Jivat Neet Kaur , Emre Kiciman , Amit Sharma

Enhancing node-level Out-Of-Distribution (OOD) generalization on graphs remains a crucial area of research. In this paper, we develop a Structural Causal Model (SCM) to theoretically dissect the performance of two prominent invariant…

Machine Learning · Computer Science 2025-01-06 Qixun Wang , Yifei Wang , Yisen Wang , Xianghua Ying

Out-of-distribution (OOD) generalisation aims to build a model that can generalise well on an unseen target domain using knowledge from multiple source domains. To this end, the model should seek the causal dependence between inputs and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Toan Nguyen , Kien Do , Duc Thanh Nguyen , Bao Duong , Thin Nguyen

Evaluating the quality of post-hoc explanations for Graph Neural Networks (GNNs) remains a significant challenge. While recent years have seen an increasing development of explainability methods, current evaluation metrics (e.g., fidelity,…

Machine Learning · Computer Science 2026-02-10 Ding Zhang , Siddharth Betala , Chirag Agarwal

Graph machine learning has witnessed rapid growth, driving advancements across diverse domains. However, the in-distribution assumption, where training and testing data share the same distribution, often breaks in real-world scenarios,…

Machine Learning · Computer Science 2025-02-13 Tingyi Cai , Yunliang Jiang , Yixin Liu , Ming Li , Changqin Huang , Shirui Pan

Learning multi-agent system dynamics has been extensively studied for various real-world applications, such as molecular dynamics in biology. Most of the existing models are built to learn single system dynamics from observed historical…

Machine Learning · Computer Science 2023-07-11 Zijie Huang , Yizhou Sun , Wei Wang

Graph Neural Networks (GNNs) show promising results for graph tasks. However, existing GNNs' generalization ability will degrade when there exist distribution shifts between testing and training graph data. The cardinal impetus underlying…

Machine Learning · Computer Science 2023-12-21 Zhengyu Chen , Teng Xiao , Kun Kuang , Zheqi Lv , Min Zhang , Jinluan Yang , Chengqiang Lu , Hongxia Yang , Fei Wu

The assumption of independence between observations (units) in a dataset is prevalent across various methodologies for learning causal graphical models. However, this assumption often finds itself in conflict with real-world data, posing…

Machine Learning · Computer Science 2024-12-31 Alex Chen , Qing Zhou

The invariance principle from causality is at the heart of notable approaches such as invariant risk minimization (IRM) that seek to address out-of-distribution (OOD) generalization failures. Despite the promising theory, invariance…

Recent interest in the external validity of prediction models (i.e., the problem of different train and test distributions, known as dataset shift) has produced many methods for finding predictive distributions that are invariant to dataset…

Machine Learning · Statistics 2022-07-20 Adarsh Subbaswamy , Bryant Chen , Suchi Saria

Probabilistic knowledge graph embeddings represent entities as distributions, using learned variances to quantify epistemic uncertainty. We identify a fundamental limitation: these variances are relation-agnostic, meaning an entity receives…

Machine Learning · Computer Science 2026-01-05 Chorok Lee

Explainability of graph neural networks (GNNs) aims to answer "Why the GNN made a certain prediction?", which is crucial to interpret the model prediction. The feature attribution framework distributes a GNN's prediction to its input…

Machine Learning · Computer Science 2022-02-02 Ying-Xin Wu , Xiang Wang , An Zhang , Xia Hu , Fuli Feng , Xiangnan He , Tat-Seng Chua

Most existing methods that address out-of-distribution (OOD) generalization for node classification on graphs primarily focus on a specific type of data biases, such as label selection bias or structural bias. However, anticipating the type…

Machine Learning · Computer Science 2023-11-07 Guoxin Chen , Yongqing Wang , Fangda Guo , Qinglang Guo , Jiangli Shao , Huawei Shen , Xueqi Cheng