English
Related papers

Related papers: On out-of-distribution detection with Bayesian neu…

200 papers

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Sen Pei

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

Machine Learning · Computer Science 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

Bayesian neural networks (BNNs) have recently gained popularity due to their ability to quantify model uncertainty. However, specifying a prior for BNNs that captures relevant domain knowledge is often extremely challenging. In this work,…

Machine Learning · Computer Science 2024-02-22 Dylan Sam , Rattana Pukdee , Daniel P. Jeong , Yewon Byun , J. Zico Kolter

Understanding the relationships between data points in the latent decision space derived by the deep learning system is critical to evaluating and interpreting the performance of the system on real world data. Detecting…

Machine Learning · Statistics 2025-11-20 Katie Rainey , Erin Hausmann , Donald Waagen , David Gray , Donald Hulsey

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

Machine Learning · Statistics 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing…

Machine Learning · Computer Science 2025-01-16 Konstantin Garov , Kamalika Chaudhuri

Existing out-of-distribution (OOD) detectors are often tuned by a separate dataset deemed OOD with respect to the training distribution of a neural network (NN). OOD detectors process the activations of NN layers and score the output, where…

Machine Learning · Computer Science 2026-02-06 Sudeepta Mondal , Xinyi Mary Xie , Ruxiao Duan , Alex Wong , Ganesh Sundaramoorthi

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-02-28 Zhen Fang , Yixuan Li , Jie Lu , Jiahua Dong , Bo Han , Feng Liu

Out-of-distribution (OOD) detection and uncertainty estimation (UE) are critical components for building safe machine learning systems, especially in real-world scenarios where unexpected inputs are inevitable. However the two problems…

Machine Learning · Computer Science 2025-12-01 Pirzada Suhail , Rehna Afroz , Gouranga Bala , Amit Sethi

Deep neural networks achieve superior performance in semantic segmentation, but are limited to a predefined set of classes, which leads to failures when they encounter unknown objects in open-world scenarios. Recognizing and segmenting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Arnold Brosch , Abdelrahman Eldesokey , Michael Felsberg , Kira Maag

Deep Bayesian neural networks (BNNs) are a powerful tool, though computationally demanding, to perform parameter estimation while jointly estimating uncertainty around predictions. BNNs are typically implemented using arbitrary…

Machine Learning · Computer Science 2020-05-12 Daniele Silvestro , Tobias Andermann

The training and test data for deep-neural-network-based classifiers are usually assumed to be sampled from the same distribution. When part of the test samples are drawn from a distribution that is sufficiently far away from that of the…

Machine Learning · Computer Science 2021-12-14 Yinan Wang , Wenbo Sun , Jionghua "Judy" Jin , Zhenyu "James" Kong , Xiaowei Yue

Deep neural network, despite its remarkable capability of discriminating targeted in-distribution samples, shows poor performance on detecting anomalous out-of-distribution data. To address this defect, state-of-the-art solutions choose to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Boxi Wu , Jie Jiang , Haidong Ren , Zifan Du , Wenxiao Wang , Zhifeng Li , Deng Cai , Xiaofei He , Binbin Lin , Wei Liu

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

This paper presents a fast, principled approach for detecting anomalous and out-of-distribution (OOD) samples in deep neural networks (DNN). We propose the application of linear statistical dimensionality reduction techniques on the…

Machine Learning · Computer Science 2022-03-22 Ibrahima J. Ndiour , Nilesh A. Ahuja , Omesh Tickoo

Out-of-distribution (OOD) detection is crucial for the deployment of machine learning models in the open world. While existing OOD detectors are effective in identifying OOD samples that deviate significantly from in-distribution (ID) data,…

Machine Learning · Computer Science 2024-12-10 Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk

3D object detection is an essential part of automated driving, and deep neural networks (DNNs) have achieved state-of-the-art performance for this task. However, deep models are notorious for assigning high confidence scores to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Chengjie Huang , Van Duong Nguyen , Vahdat Abdelzad , Christopher Gus Mannes , Luke Rowe , Benjamin Therien , Rick Salay , Krzysztof Czarnecki

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little