English
Related papers

Related papers: Understanding and Improving Feature Learning for O…

200 papers

Out-of-Distribution (OOD) detection is crucial for the reliable deployment of machine learning models in-the-wild, enabling accurate identification of test samples that differ from the training data distribution. Existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Ruisong Han , Zongbo Han , Jiahao Zhang , Mingyue Cheng , Changqing Zhang

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

Machine Learning · Computer Science 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

Recently, learning a model that generalizes well on out-of-distribution (OOD) data has attracted great attention in the machine learning community. In this paper, after defining OOD generalization via Wasserstein distance, we theoretically…

Machine Learning · Computer Science 2021-05-25 Mingyang Yi , Lu Hou , Jiacheng Sun , Lifeng Shang , Xin Jiang , Qun Liu , Zhi-Ming Ma

In the past decades, machine learning with Empirical Risk Minimization (ERM) has demonstrated great capability in learning and exploiting the statistical patterns from data, or even surpassing humans. Despite the success, ERM avoids the…

Machine Learning · Computer Science 2025-06-17 Yongqiang Chen

Out-of-Distribution (OOD) detection is a crucial problem for the safe deployment of machine learning models identifying samples that fall outside of the training distribution, i.e. in-distribution data (ID). Most OOD works focus on the…

Machine Learning · Computer Science 2023-10-04 Soroush Seifi , Daniel Olmeda Reino , Nikolay Chumerin , Rahaf Aljundi

Pre-trained vision foundation models have transformed many computer vision tasks. Despite their strong ability to learn discriminative and generalizable features crucial for out-of-distribution (OOD) detection, their impact on this task…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Shizhen Zhao , Jiahui Liu , Xin Wen , Haoru Tan , Xiaojuan Qi

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Sudarshan Regmi

This work tackles a central machine learning problem of performance degradation on out-of-distribution (OOD) test sets. The problem is particularly salient in medical imaging based diagnosis system that appears to be accurate but fails when…

Image and Video Processing · Electrical Eng. & Systems 2022-09-12 Xin Li , Yao Qiang , Chengyin Li , Sijia Liu , Dongxiao Zhu

A major challenge to out-of-distribution generalization is reliance on spurious features -- patterns that are predictive of the class label in the training data distribution, but not causally related to the target. Standard methods for…

Machine Learning · Computer Science 2023-06-21 Shikai Qiu , Andres Potapczynski , Pavel Izmailov , Andrew Gordon Wilson

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

Out-of-distribution (OOD) generalization is a favorable yet challenging property for deep neural networks. The core challenges lie in the limited availability of source domains that help models learn an invariant representation from the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yijiang Li , Sucheng Ren , Weipeng Deng , Yuzhi Xu , Ying Gao , Edith Ngai , Haohan Wang

Although machine learning models typically experience a drop in performance on out-of-distribution data, accuracies on in- versus out-of-distribution data are widely observed to follow a single linear trend when evaluated across a testbed…

Machine Learning · Computer Science 2021-07-01 Anders Andreassen , Yasaman Bahri , Behnam Neyshabur , Rebecca Roelofs

There is an increasing need to determine whether inputs are out-of-distribution (\emph{OOD}) for safely deploying machine learning models in the open world scenario. Typical neural classifiers are based on the closed world assumption, where…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Sen Pei , Xin Zhang , Bin Fan , Gaofeng Meng

Out-of-distribution (OoD) generalization occurs when representation learning encounters a distribution shift. This occurs frequently in practice when training and testing data come from different environments. Covariate shift is a type of…

Machine Learning · Computer Science 2026-04-22 Simon Zhang , Ryan P. DeMilt , Kun Jin , Cathy H. Xia

Although pretrained Transformers such as BERT achieve high accuracy on in-distribution examples, do they generalize to new distributions? We systematically measure out-of-distribution (OOD) generalization for seven NLP datasets by…

Computation and Language · Computer Science 2020-04-17 Dan Hendrycks , Xiaoyuan Liu , Eric Wallace , Adam Dziedzic , Rishabh Krishnan , Dawn Song

A crucial requirement for reliable deployment of deep learning models for safety-critical applications is the ability to identify out-of-distribution (OOD) data points, samples which differ from the training data and on which a model might…

Machine Learning · Computer Science 2021-06-11 Dennis Ulmer , Giovanni Cinà

Detecting out-of-distribution (OOD) samples is vital for developing machine learning based models for critical safety systems. Common approaches for OOD detection assume access to some OOD samples during training which may not be available…

Machine Learning · Computer Science 2021-10-19 Koby Bibas , Meir Feder , Tal Hassner

Uncertainty estimation is a key component in any deployed machine learning system. One way to evaluate uncertainty estimation is using "out-of-distribution" (OoD) detection, that is, distinguishing between the training data distribution and…

Machine Learning · Computer Science 2021-12-03 Haiwen Huang , Joost van Amersfoort , Yarin Gal

Deep network models perform excellently on In-Distribution (ID) data, but can significantly fail on Out-Of-Distribution (OOD) data. While developing methods focus on improving OOD generalization, few attention has been paid to evaluating…

Machine Learning · Computer Science 2021-11-22 Rui Hu , Jitao Sang , Jinqiang Wang , Rui Hu , Chaoquan Jiang