English
Related papers

Related papers: Graph Out-of-Distribution Generalization via Causa…

200 papers

Out-of-distribution (OOD) detection and OOD generalization are widely studied in Deep Neural Networks (DNNs), yet their relationship remains poorly understood. We empirically show that the degree of Neural Collapse (NC) in a network layer…

Machine Learning · Computer Science 2025-09-23 Md Yousuf Harun , Jhair Gallardo , Christopher Kanan

A key challenge in graph out-of-distribution (OOD) detection lies in the absence of ground-truth OOD samples during training. Existing methods are typically optimized to capture features within the in-distribution (ID) data and calculate…

Machine Learning · Computer Science 2025-11-25 Yue Hou , Ruomei Liu , Yingke Su , Junran Wu , Ke Xu

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

Machine Learning · Computer Science 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

Machine Learning · Computer Science 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Deep Learning systems have achieved great success in the past few years, even surpassing human intelligence in several cases. As of late, they have also established themselves in the biomedical and healthcare domains, where they have shown…

Machine Learning · Computer Science 2022-10-06 Aristotelis Ballas , Christos Diou

Recent studies have revealed that GNNs are highly susceptible to multiple adversarial attacks. Among these, graph backdoor attacks pose one of the most prominent threats, where attackers cause models to misclassify by learning the…

Cryptography and Security · Computer Science 2024-10-21 Hao Sui , Bing Chen , Jiale Zhang , Chengcheng Zhu , Di Wu , Qinghua Lu , Guodong Long

Explainability of graph neural networks (GNNs) aims to answer "Why the GNN made a certain prediction?", which is crucial to interpret the model prediction. The feature attribution framework distributes a GNN's prediction to its input…

Machine Learning · Computer Science 2022-02-02 Ying-Xin Wu , Xiang Wang , An Zhang , Xia Hu , Fuli Feng , Xiangnan He , Tat-Seng Chua

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we…

Machine Learning · Computer Science 2021-01-22 Haotian Ye , Chuanlong Xie , Yue Liu , Zhenguo Li

Unsupervised learning has been extensively adopted to train deep neural networks (DNNs) for learning wireless resource allocation. Yet, the performance of DNNs is vulnerable to distribution shifts between training and test data, e.g.,…

Signal Processing · Electrical Eng. & Systems 2026-03-03 Shengjie Liu , Chenyang Yang

Out-of-distribution (OOD) generalization remains a fundamental challenge in real-world classification, where test distributions often differ substantially from training data. Most existing approaches pursue domain-invariant representations,…

Machine Learning · Computer Science 2026-01-30 Chen Cheng , Ang Li

We address the key challenge of size-induced distribution shifts in graph neural networks (GNNs) and their impact on the generalization of GNNs to larger graphs. Existing literature operates under diverse assumptions about distribution…

Machine Learning · Computer Science 2025-08-04 Gaotang Li , Danai Koutra , Yujun Yan

With the progressive advancements in deep graph learning, out-of-distribution (OOD) detection for graph data has emerged as a critical challenge. While the efficacy of auxiliary datasets in enhancing OOD detection has been extensively…

Machine Learning · Computer Science 2024-08-01 Junwei He , Qianqian Xu , Yangbangyan Jiang , Zitai Wang , Yuchen Sun , Qingming Huang

Deep network models perform excellently on In-Distribution (ID) data, but can significantly fail on Out-Of-Distribution (OOD) data. While developing methods focus on improving OOD generalization, few attention has been paid to evaluating…

Machine Learning · Computer Science 2021-11-22 Rui Hu , Jitao Sang , Jinqiang Wang , Rui Hu , Chaoquan Jiang

Few-shot Out-of-Distribution (OOD) detection has emerged as a critical research direction in machine learning for practical deployment. Most existing Few-shot OOD detection methods suffer from insufficient generalization capability for the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Pinxuan Li , Bing Cao , Changqing Zhang , Qinghua Hu

Embeddings produced by pre-trained deep neural networks (DNNs) are widely used; however, their efficacy for downstream tasks can vary widely. We study the factors influencing transferability and out-of-distribution (OOD) generalization of…

Machine Learning · Computer Science 2024-10-28 Md Yousuf Harun , Kyungbok Lee , Jhair Gallardo , Giri Krishnan , Christopher Kanan

We expect the generalization error to improve with more samples from a similar task, and to deteriorate with more samples from an out-of-distribution (OOD) task. In this work, we show a counter-intuitive phenomenon: the generalization error…

Machine Learning · Computer Science 2023-07-20 Ashwin De Silva , Rahul Ramesh , Carey E. Priebe , Pratik Chaudhari , Joshua T. Vogelstein

Graph contrastive learning (GCL), standing as the dominant paradigm in the realm of graph pre-training, has yielded considerable progress. Nonetheless, its capacity for out-of-distribution (OOD) generalization has been relatively…

Machine Learning · Computer Science 2024-05-28 Zixu Wang , Bingbing Xu , Yige Yuan , Huawei Shen , Xueqi Cheng

The out-of-distribution (OOD) problem generally arises when neural networks encounter data that significantly deviates from the training data distribution, i.e., in-distribution (InD). In this paper, we study the OOD problem from a neuron…

Machine Learning · Computer Science 2024-03-12 Yibing Liu , Chris Xing Tian , Haoliang Li , Lei Ma , Shiqi Wang

Out-Of-Distribution generalization (OOD) is all about learning invariance against environmental changes. If the context in every class is evenly distributed, OOD would be trivial because the context can be easily removed due to an…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Jiaxin Qi , Kaihua Tang , Qianru Sun , Xian-Sheng Hua , Hanwang Zhang

This paper focuses on out-of-distribution generalization on graphs where performance drops due to the unseen distribution shift. Previous graph domain generalization works always resort to learning an invariant predictor among different…

Machine Learning · Computer Science 2022-06-22 Junchi Yu , Jian Liang , Ran He