中文
相关论文

相关论文: Handling Distribution Shifts on Graphs: An Invaria…

200 篇论文

Out-of-distribution (OOD) detection is critical for ensuring the safety and reliability of machine learning systems, particularly in dynamic and open-world environments. In the vision and text domains, zero-shot OOD detection - which…

机器学习 · 计算机科学 2025-05-20 Haoyan Xu , Zhengtao Yao , Xuzhi Zhang , Ziyi Wang , Langzhou He , Yushun Dong , Philip S. Yu , Mengyuan Li , Yue Zhao

Graph-level representation learning is important in a wide range of applications. Existing graph-level models are generally built on i.i.d. assumption for both training and testing graphs. However, in an open world, models can encounter…

机器学习 · 计算机科学 2024-07-19 Zhihao Ding , Jieming Shi , Shiqi Shen , Xuequn Shang , Jiannong Cao , Zhipeng Wang , Zhi Gong

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

机器学习 · 计算机科学 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

机器学习 · 计算机科学 2023-12-05 Sergey Kolesnikov

Conventional wisdom suggests that neural network predictions tend to be unpredictable and overconfident when faced with out-of-distribution (OOD) inputs. Our work reassesses this assumption for neural networks with high-dimensional inputs.…

机器学习 · 计算机科学 2024-03-19 Katie Kang , Amrith Setlur , Claire Tomlin , Sergey Levine

With the progressive advancements in deep graph learning, out-of-distribution (OOD) detection for graph data has emerged as a critical challenge. While the efficacy of auxiliary datasets in enhancing OOD detection has been extensively…

机器学习 · 计算机科学 2024-08-01 Junwei He , Qianqian Xu , Yangbangyan Jiang , Zitai Wang , Yuchen Sun , Qingming Huang

The invariance principle from causality is at the heart of notable approaches such as invariant risk minimization (IRM) that seek to address out-of-distribution (OOD) generalization failures. Despite the promising theory, invariance…

The inability of deep learning models to handle data drawn from unseen distributions has sparked much interest in unsupervised out-of-distribution (U-OOD) detection, as it is crucial for reliable deep learning models. Despite considerable…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Lars Doorenbos , Raphael Sznitman , Pablo Márquez-Neila

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

机器学习 · 计算机科学 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

机器学习 · 统计学 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu

Invariant graph representation learning aims to learn the invariance among data from different environments for out-of-distribution generalization on graphs. As the graph environment partitions are usually expensive to obtain, augmenting…

机器学习 · 计算机科学 2023-10-31 Yongqiang Chen , Yatao Bian , Kaiwen Zhou , Binghui Xie , Bo Han , James Cheng

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

机器学习 · 计算机科学 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui

Detecting out-of-distribution (OOD) nodes in the graph-based machine-learning field is challenging, particularly when in-distribution (ID) node multi-category labels are unavailable. Thus, we focus on feature space rather than label space…

机器学习 · 计算机科学 2025-10-24 Shenzhi Yang , Junbo Zhao , Sharon Li , Shouqing Yang , Dingyu Yang , Xiaofang Zhang , Haobo Wang

Distributional shift is one of the major obstacles when transferring machine learning prediction systems from the lab to the real world. To tackle this problem, we assume that variation across training domains is representative of the…

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

机器学习 · 计算机科学 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

机器学习 · 计算机科学 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra

Dynamic graph neural networks (DyGNNs) have demonstrated powerful predictive abilities by exploiting graph structural and temporal dynamics. However, the existing DyGNNs fail to handle distribution shifts, which naturally exist in dynamic…

机器学习 · 计算机科学 2024-03-11 Zeyang Zhang , Xin Wang , Ziwei Zhang , Haoyang Li , Wenwu Zhu

Out-of-distribution (OOD) generalization is an important issue for Graph Neural Networks (GNNs). Recent works employ different graph editions to generate augmented environments and learn an invariant GNN for generalization. However, the…

机器学习 · 计算机科学 2023-03-28 Junchi Yu , Jian Liang , Ran He