English
Related papers

Related papers: GOOD: A Graph Out-of-Distribution Benchmark

200 papers

The task of out-of-distribution (OOD) detection is notoriously ill-defined. Earlier works focused on new-class detection, aiming to identify label-altering data distribution shifts, also known as "semantic shift." However, recent works…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 William Yang , Byron Zhang , Olga Russakovsky

Despite recent success in using the invariance principle for out-of-distribution (OOD) generalization on Euclidean data (e.g., images), studies on graph data are still limited. Different from images, the complex nature of graphs poses…

Machine Learning · Computer Science 2022-10-12 Yongqiang Chen , Yonggang Zhang , Yatao Bian , Han Yang , Kaili Ma , Binghui Xie , Tongliang Liu , Bo Han , James Cheng

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

In image classification, a lot of development has happened in detecting out-of-distribution (OoD) data. However, most OoD detection methods are evaluated on a standard set of datasets, arbitrarily different from training data. There is no…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Jishnu Mukhoti , Tsung-Yu Lin , Bor-Chun Chen , Ashish Shah , Philip H. S. Torr , Puneet K. Dokania , Ser-Nam Lim

Current out-of-distribution (OOD) detection benchmarks are commonly built by defining one dataset as in-distribution (ID) and all others as OOD. However, these benchmarks unfortunately introduce some unwanted and impractical goals, e.g., to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Jingkang Yang , Haoqi Wang , Litong Feng , Xiaopeng Yan , Huabin Zheng , Wayne Zhang , Ziwei Liu

Out-of-distribution (OOD) detection identifies test samples that differ from the training data, which is critical to ensuring the safety and reliability of machine learning (ML) systems. While a plethora of methods have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Viet Duong , Qiong Wu , Zhengyi Zhou , Eric Zavesky , Jiahe Chen , Xiangzhou Liu , Wen-Ling Hsu , Huajie Shao

Harnessing the power of diffusion models to synthesize auxiliary training data based on latent space features has proven effective in enhancing out-of-distribution (OOD) detection performance. However, extracting effective features outside…

Machine Learning · Computer Science 2025-11-25 Qilin Liao , Shuo Yang , Bo Zhao , Ping Luo , Hengshuang Zhao

For reliable deployment of deep-learning systems, out-of-distribution (OOD) detection is indispensable. In the real world, where test-time inputs often arrive as streaming mixtures of in-distribution (ID) and OOD samples under evolving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Wooseok Lee , Jin Mo Yang , Saewoong Bahk , Hyung-Sin Kim

In this work, we investigate the problem of out-of-distribution (OOD) generalization for unsupervised learning methods on graph data. This scenario is particularly challenging because graph neural networks (GNNs) have been shown to be…

Machine Learning · Computer Science 2023-08-03 Yun Zhu , Haizhou Shi , Zhenshuo Zhang , Siliang Tang

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

Machine Learning · Computer Science 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

Modern machine learning models deployed often encounter distribution shifts in real-world applications, manifesting as covariate or semantic out-of-distribution (OOD) shifts. These shifts give rise to challenges in OOD generalization and…

Machine Learning · Computer Science 2024-10-11 Haoyue Bai , Jifan Zhang , Robert Nowak

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Out-of-distribution detection is a common issue in deploying vision models in practice and solving it is an essential building block in safety critical applications. Most of the existing OOD detection solutions focus on improving the OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tomas Vojir , Jan Sochman , Rahaf Aljundi , Jiri Matas

Graph Neural Networks (GNNs) have achieved impressive performance in graph-related tasks. However, they suffer from poor generalization on out-of-distribution (OOD) data, as they tend to learn spurious correlations. Such correlations…

Machine Learning · Statistics 2026-03-26 Bowen Lu , Liangqiang Yang , Teng Li

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

Machine Learning · Computer Science 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

With the progressive advancements in deep graph learning, out-of-distribution (OOD) detection for graph data has emerged as a critical challenge. While the efficacy of auxiliary datasets in enhancing OOD detection has been extensively…

Machine Learning · Computer Science 2024-08-01 Junwei He , Qianqian Xu , Yangbangyan Jiang , Zitai Wang , Yuchen Sun , Qingming Huang

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

Machine Learning · Computer Science 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Data-driven molecular discovery leverages artificial intelligence/machine learning (AI/ML) and generative modeling to filter and design novel molecules. Discovering novel molecules requires accurate out-of-distribution (OOD) predictions,…

High-performing out-of-distribution (OOD) detection, both anomaly and novel class, is an important prerequisite for the practical use of classification models. In this paper, we focus on the species recognition task in images concerned with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 L. E. Hogeweg , R. Gangireddy , D. Brunink , V. J. Kalkman , L. Cornelissen , J. W. Kamminga